Apr 20 18:38:13 user devstack@n-api.service[61665]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 18:38:13 user devstack@n-api.service[61665]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 18:38:13 2023] *** Apr 20 18:38:13 user devstack@n-api.service[61665]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 18:38:13 user devstack@n-api.service[61665]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 18:38:13 user devstack@n-api.service[61665]: nodename: user Apr 20 18:38:13 user devstack@n-api.service[61665]: machine: x86_64 Apr 20 18:38:13 user devstack@n-api.service[61665]: clock source: unix Apr 20 18:38:13 user devstack@n-api.service[61665]: pcre jit disabled Apr 20 18:38:13 user devstack@n-api.service[61665]: detected number of CPU cores: 12 Apr 20 18:38:13 user devstack@n-api.service[61665]: current working directory: / Apr 20 18:38:13 user devstack@n-api.service[61665]: detected binary path: /usr/bin/uwsgi-core Apr 20 18:38:13 user devstack@n-api.service[61665]: your processes number limit is 63637 Apr 20 18:38:13 user devstack@n-api.service[61665]: your memory page size is 4096 bytes Apr 20 18:38:13 user devstack@n-api.service[61665]: detected max file descriptor number: 2048 Apr 20 18:38:13 user devstack@n-api.service[61665]: lock engine: pthread robust mutexes Apr 20 18:38:13 user devstack@n-api.service[61665]: thunder lock: enabled Apr 20 18:38:13 user devstack@n-api.service[61665]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 18:38:13 user devstack@n-api.service[61665]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 18:38:13 user devstack@n-api.service[61665]: Python main interpreter initialized at 0x55ab0d4ce990 Apr 20 18:38:13 user devstack@n-api.service[61665]: python threads support enabled Apr 20 18:38:13 user devstack@n-api.service[61665]: your server socket listen backlog is limited to 100 connections Apr 20 18:38:13 user devstack@n-api.service[61665]: your mercy for graceful operations on workers is 90 seconds Apr 20 18:38:13 user devstack@n-api.service[61665]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 18:38:13 user devstack@n-api.service[61665]: *** Operational MODE: preforking *** Apr 20 18:38:13 user devstack@n-api.service[61665]: *** uWSGI is running in multiple interpreter mode *** Apr 20 18:38:13 user devstack@n-api.service[61665]: spawned uWSGI master process (pid: 61665) Apr 20 18:38:13 user devstack@n-api.service[61665]: spawned uWSGI worker 1 (pid: 61666, cores: 1) Apr 20 18:38:13 user devstack@n-api.service[61665]: spawned uWSGI worker 2 (pid: 61667, cores: 1) Apr 20 18:38:13 user devstack@n-api.service[61665]: spawned uWSGI worker 3 (pid: 61668, cores: 1) Apr 20 18:38:13 user devstack@n-api.service[61665]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 18:38:13 user devstack@n-api.service[61666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 18:38:13 user devstack@n-api.service[61667]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 18:38:13 user devstack@n-api.service[61668]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 18:38:17 user devstack@n-api.service[61666]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 18:38:17 user devstack@n-api.service[61666]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 18:38:17 user devstack@n-api.service[61666]: and ``live_migration_inbound_addr`` respectively. Apr 20 18:38:17 user devstack@n-api.service[61666]: ). Its value may be silently ignored in the future. Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 18:38:17 user devstack@n-api.service[61667]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 18:38:17 user devstack@n-api.service[61667]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 18:38:17 user devstack@n-api.service[61667]: and ``live_migration_inbound_addr`` respectively. Apr 20 18:38:17 user devstack@n-api.service[61667]: ). Its value may be silently ignored in the future. Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 18:38:17 user devstack@n-api.service[61668]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 18:38:17 user devstack@n-api.service[61668]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 18:38:17 user devstack@n-api.service[61668]: and ``live_migration_inbound_addr`` respectively. Apr 20 18:38:17 user devstack@n-api.service[61668]: ). Its value may be silently ignored in the future. Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61666) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61667) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61668) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 18:38:17 user devstack@n-api.service[61666]: INFO dbcounter [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Registered counter for database nova_api Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_db.sqlalchemy.engines [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61666) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writer thread running {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG nova.context [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e570c5e4-d2bb-4eb5-ba69-c1c987d683f8(cell1) {{(pid=61666) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:38:17 user devstack@n-api.service[61666]: INFO dbcounter [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Registered counter for database nova_cell0 Apr 20 18:38:17 user devstack@n-api.service[61666]: INFO dbcounter [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Registered counter for database nova_cell1 Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_db.sqlalchemy.engines [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61666) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_db.sqlalchemy.engines [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61666) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writer thread running {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61668]: INFO dbcounter [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Registered counter for database nova_api Apr 20 18:38:17 user devstack@n-api.service[61667]: INFO dbcounter [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Registered counter for database nova_api Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writer thread running {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_db.sqlalchemy.engines [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61667) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writer thread running {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_db.sqlalchemy.engines [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61668) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writer thread running {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG nova.context [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e570c5e4-d2bb-4eb5-ba69-c1c987d683f8(cell1) {{(pid=61667) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:38:17 user devstack@n-api.service[61667]: INFO dbcounter [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Registered counter for database nova_cell0 Apr 20 18:38:17 user devstack@n-api.service[61667]: INFO dbcounter [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Registered counter for database nova_cell1 Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_db.sqlalchemy.engines [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61667) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writer thread running {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_db.sqlalchemy.engines [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61667) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61666]: INFO dbcounter [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Registered counter for database nova_cell0 Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG nova.context [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e570c5e4-d2bb-4eb5-ba69-c1c987d683f8(cell1) {{(pid=61668) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG oslo_db.sqlalchemy.engines [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61666) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:38:17 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writer thread running {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:38:17 user devstack@n-api.service[61668]: INFO dbcounter [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Registered counter for database nova_cell0 Apr 20 18:38:17 user devstack@n-api.service[61668]: INFO dbcounter [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Registered counter for database nova_cell1 Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_db.sqlalchemy.engines [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61668) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writer thread running {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_db.sqlalchemy.engines [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61668) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writer thread running {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61667]: INFO dbcounter [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Registered counter for database nova_cell0 Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG oslo_db.sqlalchemy.engines [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61667) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writer thread running {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writer thread running {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61668]: INFO dbcounter [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Registered counter for database nova_cell0 Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG oslo_db.sqlalchemy.engines [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61668) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 18:38:17 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writer thread running {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 18:38:17 user devstack@n-api.service[61666]: WARNING keystonemiddleware.auth_token [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:38:17 user devstack@n-api.service[61666]: WARNING keystonemiddleware.auth_token [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:38:18 user devstack@n-api.service[61667]: WARNING keystonemiddleware.auth_token [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:38:18 user devstack@n-api.service[61668]: WARNING keystonemiddleware.auth_token [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:38:18 user devstack@n-api.service[61667]: WARNING keystonemiddleware.auth_token [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:38:18 user devstack@n-api.service[61668]: WARNING keystonemiddleware.auth_token [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:38:18 user devstack@n-api.service[61666]: WARNING keystonemiddleware.auth_token [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:38:18 user devstack@n-api.service[61666]: WARNING keystonemiddleware.auth_token [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:38:18 user devstack@n-api.service[61666]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab0d4ce990 pid: 61666 (default app) Apr 20 18:38:18 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:38:18 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001615 Apr 20 18:38:18 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 18:38:18 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:38:18 user devstack@n-api.service[61667]: WARNING keystonemiddleware.auth_token [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:38:18 user devstack@n-api.service[61667]: WARNING keystonemiddleware.auth_token [None req-d27082ab-937a-4203-8e60-249ef7d95544 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:38:18 user devstack@n-api.service[61667]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab0d4ce990 pid: 61667 (default app) Apr 20 18:38:18 user devstack@n-api.service[61668]: WARNING keystonemiddleware.auth_token [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 18:38:18 user devstack@n-api.service[61668]: WARNING keystonemiddleware.auth_token [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 18:38:18 user devstack@n-api.service[61668]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab0d4ce990 pid: 61668 (default app) Apr 20 18:40:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-c42e4e0a-1f87-4988-8553-4c5dec2acc41 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001861 Apr 20 18:40:26 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:26 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:26 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:26 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:26 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-cf6bfaa1-38c6-457b-9397-2e4362e2fbd9 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-cf6bfaa1-38c6-457b-9397-2e4362e2fbd9 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.373213 Apr 20 18:40:26 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 18:40:26 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:28 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:28 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002031 Apr 20 18:40:28 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:28 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:28 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:28 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:28 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:28 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:28 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8f977d82-6135-4862-b650-837cdb9554a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8f977d82-6135-4862-b650-837cdb9554a3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.346968 Apr 20 18:40:28 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:28 2023] POST /compute/v2.1/flavors => generated 405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 18:40:28 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-b677e89b-6902-4467-860b-181b5c063263 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:28 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-b677e89b-6902-4467-860b-181b5c063263 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045764 Apr 20 18:40:28 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 18:40:28 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:30 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:30 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001987 Apr 20 18:40:30 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:30 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-e384cef1-64bd-40a8-808b-6cda5dd314f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:30 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-e384cef1-64bd-40a8-808b-6cda5dd314f2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.062018 Apr 20 18:40:30 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:30 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:30 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-1f1cde71-79ad-420f-a606-f4aba382e810 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:30 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-1f1cde71-79ad-420f-a606-f4aba382e810 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039671 Apr 20 18:40:30 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 18:40:30 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:32 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001441 Apr 20 18:40:32 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:32 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:32 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-84f99965-3acd-4338-ad03-657e6b7b9476 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-84f99965-3acd-4338-ad03-657e6b7b9476 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073288 Apr 20 18:40:32 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:32 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:32 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6ff0fa54-31a3-4ab7-8669-d00e8d451c51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:33 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-6ff0fa54-31a3-4ab7-8669-d00e8d451c51 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032038 Apr 20 18:40:33 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 18:40:32 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:34 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001362 Apr 20 18:40:34 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:34 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:35 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-914f3a0e-e8e1-4a0a-9358-1c5c9bc70c94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 2, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:35 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-914f3a0e-e8e1-4a0a-9358-1c5c9bc70c94 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.069460 Apr 20 18:40:35 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:34 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:35 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-b41cfde9-8ac2-4068-a145-30e606da1cac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:35 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-b41cfde9-8ac2-4068-a145-30e606da1cac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028757 Apr 20 18:40:35 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 18:40:35 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:37 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:37 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001479 Apr 20 18:40:37 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:37 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:37 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-88f19186-7351-42d6-87df-1a1fc9b0808d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "disk": 20}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:37 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-88f19186-7351-42d6-87df-1a1fc9b0808d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.055893 Apr 20 18:40:37 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:37 2023] POST /compute/v2.1/flavors => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:37 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:37 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025334 Apr 20 18:40:37 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 18:40:37 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:39 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:39 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-412b43aa-adf0-41d0-b6ca-363cf80d7760 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002225 Apr 20 18:40:39 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:39 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:40:39 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f1fee5a2-893c-496f-852a-c010a922db8f admin admin] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:39 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f1fee5a2-893c-496f-852a-c010a922db8f admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.067225 Apr 20 18:40:39 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 18:40:39 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:40:40 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:40 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002051 Apr 20 18:40:40 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:40 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:40 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:40 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:40 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:40 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:40:41 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-b756c702-18b9-4c48-a63c-e27fa8089cec admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:41 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-b756c702-18b9-4c48-a63c-e27fa8089cec admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.331620 Apr 20 18:40:41 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:40 2023] POST /compute/v2.1/flavors => generated 400 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:41 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-b1ecbe00-14ed-4b81-bd58-3c5d1440fd89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:41 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-b1ecbe00-14ed-4b81-bd58-3c5d1440fd89 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053119 Apr 20 18:40:41 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 18:40:41 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:43 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:43 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002379 Apr 20 18:40:43 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:43 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:43 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-299830d3-ff3e-4eb5-83e9-e8d7215835b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "ram": 2048}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:43 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-299830d3-ff3e-4eb5-83e9-e8d7215835b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060545 Apr 20 18:40:43 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:43 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:43 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-eac53b4e-929c-4e2e-b17a-40a1f5e17a6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:43 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-eac53b4e-929c-4e2e-b17a-40a1f5e17a6b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033783 Apr 20 18:40:43 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 18:40:43 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:45 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:45 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002496 Apr 20 18:40:45 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:45 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:45 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-246865af-49b0-4bad-8061-4598247cbdd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:45 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-246865af-49b0-4bad-8061-4598247cbdd7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.058238 Apr 20 18:40:45 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:45 2023] POST /compute/v2.1/flavors => generated 404 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:45 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-de181fbd-8828-4519-878d-e68abde2acc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:45 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-de181fbd-8828-4519-878d-e68abde2acc1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026799 Apr 20 18:40:45 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 18:40:45 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:40:47 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001586 Apr 20 18:40:47 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:47 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:47 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-5a5bc401-099b-4c30-9cfb-4f8cc42487ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "swap": 0, "disk": 80, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:47 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-5a5bc401-099b-4c30-9cfb-4f8cc42487ff admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066070 Apr 20 18:40:47 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:47 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:47 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-c6d3a5c8-8917-4bc9-8db9-1e2124b97795 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:47 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-c6d3a5c8-8917-4bc9-8db9-1e2124b97795 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027163 Apr 20 18:40:47 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 18:40:47 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:40:49 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:40:49 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003251 Apr 20 18:40:49 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 18:40:49 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:40:49 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c5b21958-6281-4053-8d78-d84f4794ece5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:49 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-c5b21958-6281-4053-8d78-d84f4794ece5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060871 Apr 20 18:40:49 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 18:40:49 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:40:49 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-78c21abb-0661-45c9-a7d4-54ec5da57a3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:40:49 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-78c21abb-0661-45c9-a7d4-54ec5da57a3a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024395 Apr 20 18:40:49 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 18:40:49 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:41:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a6c5c08b-7b22-4667-8462-eefcfd9bf721 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001523 Apr 20 18:41:20 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 18:41:20 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:41:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:41:20 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.089869 Apr 20 18:41:20 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 18:41:20 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:41:51 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-78c21abb-0661-45c9-a7d4-54ec5da57a3a admin admin] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:41:51 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-78c21abb-0661-45c9-a7d4-54ec5da57a3a admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001469 Apr 20 18:41:51 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 18:41:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:51 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:41:51 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a7ce9987-1e9d-43af-955d-2e1c1f1d8869 admin admin] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:41:51 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a7ce9987-1e9d-43af-955d-2e1c1f1d8869 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.074650 Apr 20 18:41:51 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 18:41:51 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:41:55 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:41:55 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001545 Apr 20 18:41:55 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 18:41:55 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:55 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:41:55 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-16ef3a3b-d93a-4394-9276-6293b28c00c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.nano", "disk": 1, "swap": 0, "id": "42"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:55 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-16ef3a3b-d93a-4394-9276-6293b28c00c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067819 Apr 20 18:41:55 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 18:41:55 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:41:55 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8536826f-3a3e-434f-bcd0-00c0a0c1f84d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:55 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8536826f-3a3e-434f-bcd0-00c0a0c1f84d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025096 Apr 20 18:41:55 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 18:41:55 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:41:59 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:41:59 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d348f3bb-03e7-4304-8ab5-9c22e7f2e9b1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002218 Apr 20 18:41:59 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 18:41:59 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:41:59 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-c811e01e-2b8f-4f5d-ad4b-1bfab865fb00 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.micro", "vcpus": 1, "id": "84", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 192}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:59 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-c811e01e-2b8f-4f5d-ad4b-1bfab865fb00 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076495 Apr 20 18:41:59 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 18:41:59 2023] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:41:59 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-d4d9971c-e355-41a3-bd1d-2c14320af682 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:41:59 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-d4d9971c-e355-41a3-bd1d-2c14320af682 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025494 Apr 20 18:41:59 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 18:41:59 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:25 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:25 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:25 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:25 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6967e784-0e4d-4c7b-8b12-eb39bc2efba5 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Action: 'create', calling method: .version_select at 0x7fe63f606200>, body: {"keypair": {"name": "tempest-keypair-451012052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbSMXzGUjsFtifIS7RxaZwn0pjRCDveOEubhEMPAto43Tuut9sGrbsmEVfeWsAbXEasl+8WC/7GgIvGzXvL80u3BIT7a8Gs1+HsVhcGBnwCj/WV0BOwX70ihWLj8VoDYA=="}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:25 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-6967e784-0e4d-4c7b-8b12-eb39bc2efba5 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Getting quotas for project 0a090198081045f0a7ad32c8c9898ed6. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:25 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-6967e784-0e4d-4c7b-8b12-eb39bc2efba5 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Getting quotas for user beb60a516ce54dca948df4efb3d5aa68 and project 0a090198081045f0a7ad32c8c9898ed6. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-6967e784-0e4d-4c7b-8b12-eb39bc2efba5 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.201777 Apr 20 18:44:25 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:44:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:25 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:25 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-6e21f212-a471-44f9-8dc3-1660c6e2a61f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Action: 'create', calling method: .version_select at 0x7fe63f79a290>, body: {"keypair": {"name": "tempest-keypair-372469975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwOI9qRrh0EpbLSJYksX40SdnHtJMpYRDe70xFD9c3lQ6/fC4k5ouUEZnvr3BIsKiqCNOfOmb845fPGyiBTqxUfeD03hfvFgGej5x5EBGblrtZ8ab/j5/id2bjc4jXhcA=="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:25 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-6e21f212-a471-44f9-8dc3-1660c6e2a61f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:25 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-6e21f212-a471-44f9-8dc3-1660c6e2a61f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for user 2c6275ba3d2249c7a04952e5726bb633 and project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-6e21f212-a471-44f9-8dc3-1660c6e2a61f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.161412 Apr 20 18:44:26 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:44:25 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:26 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-621713971", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:26 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] validate_networks() for [('903a48de-91f2-4344-b1d1-a4cd3429c840', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:28 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-820219014", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "78182955-0c56-4482-883d-f27a4ac8dce7"}]}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:29 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] validate_networks() for [('78182955-0c56-4482-883d-f27a4ac8dce7', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Getting quotas for project 641b4a94c3114312ae2f8b3658921374. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Getting quotas for user e33a2234ce2640f59dbf4dc4e693b0af and project 641b4a94c3114312ae2f8b3658921374. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:29 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:29 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-c821af3c-5b17-4545-8a3b-e75839835d1f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 3.164802 Apr 20 18:44:29 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:26 2023] POST /compute/v2.1/servers => generated 381 bytes in 3167 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:29 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-9377db9d-2c4f-4427-80d6-97e6fb6cbce2 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:29 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-9377db9d-2c4f-4427-80d6-97e6fb6cbce2 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:30 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-9377db9d-2c4f-4427-80d6-97e6fb6cbce2 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:30 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-9377db9d-2c4f-4427-80d6-97e6fb6cbce2 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9" status: 200 len: 1215 microversion: 2.1 time: 0.832893 Apr 20 18:44:30 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:29 2023] GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9 => generated 1215 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:30 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8df5e66e-759f-464c-a5e6-c0d38d5e1177 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Action: 'create', calling method: .version_select at 0x7fe63f688b80>, body: {"keypair": {"name": "tempest-keypair-263672336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEWXlLyU7FDdOuA4wPSC0Pne+JIDTbg2nFM9uj7O0jn91zSDWsfA2CeFL9w/s5p8MS1BM6ddaGKqDSV+SBwRK7i4LzI+JtVHGMkcL1uNHegefluAvSNvJM025JkopbA5Q=="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:30 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-8df5e66e-759f-464c-a5e6-c0d38d5e1177 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Getting quotas for project c72b0b62c9544459ab1fdac7a8938d13. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:30 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-8df5e66e-759f-464c-a5e6-c0d38d5e1177 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Getting quotas for user 700556715e4440448e91a864a0086e02 and project c72b0b62c9544459ab1fdac7a8938d13. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:30 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8df5e66e-759f-464c-a5e6-c0d38d5e1177 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.248255 Apr 20 18:44:30 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 17/50] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:44:30 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:30 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-855879695", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:30 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] validate_networks() for [('903a48de-91f2-4344-b1d1-a4cd3429c840', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:31 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-81644810", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "f68cc5f6-6813-4723-b9fb-e94f5d080a1b"}], "security_groups": [{"name": "tempest-securitygroup--711538812"}], "key_name": "tempest-keypair-451012052", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Getting quotas for project e43f36361a5645daa15f3a00fc385e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Getting quotas for user 3d64688e63e442ae8202dfb4a9b0f391 and project e43f36361a5645daa15f3a00fc385e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-22259d87-95a6-4085-a763-43ec7150799c tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.531450 Apr 20 18:44:32 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 16/51] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 3533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-aa69732a-3710-4a67-847f-f35f3e70cb15 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-aa69732a-3710-4a67-847f-f35f3e70cb15 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:32 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] validate_networks() for [('f68cc5f6-6813-4723-b9fb-e94f5d080a1b', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:32 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-aa69732a-3710-4a67-847f-f35f3e70cb15 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d64688e63e442ae8202dfb4a9b0f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f36361a5645daa15f3a00fc385e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-aa69732a-3710-4a67-847f-f35f3e70cb15 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc" status: 200 len: 1208 microversion: 2.1 time: 0.261695 Apr 20 18:44:32 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:32 2023] GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc => generated 1208 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Getting quotas for project 641b4a94c3114312ae2f8b3658921374. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Getting quotas for user e33a2234ce2640f59dbf4dc4e693b0af and project 641b4a94c3114312ae2f8b3658921374. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:33 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:34 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-d3e8dea0-8565-48d7-81a1-e32273c33cfb tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 3.306625 Apr 20 18:44:34 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 19/53] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:30 2023] POST /compute/v2.1/servers => generated 381 bytes in 3309 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:34 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-736de0ff-f193-4c0e-b654-df2f7152a825 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:34 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-736de0ff-f193-4c0e-b654-df2f7152a825 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Getting quotas for project 0a090198081045f0a7ad32c8c9898ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Getting quotas for user beb60a516ce54dca948df4efb3d5aa68 and project 0a090198081045f0a7ad32c8c9898ed6. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-05b4cace-599d-4068-90b8-6de2e3930c64 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.427682 Apr 20 18:44:34 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:31 2023] POST /compute/v2.1/servers => generated 403 bytes in 2429 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:34 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-cda17031-e0d2-4225-9dc9-7138daa7ecb2 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:34 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-cda17031-e0d2-4225-9dc9-7138daa7ecb2 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:34 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-736de0ff-f193-4c0e-b654-df2f7152a825 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-736de0ff-f193-4c0e-b654-df2f7152a825 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 200 len: 1215 microversion: 2.1 time: 0.309765 Apr 20 18:44:34 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:34 2023] GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:34 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-cda17031-e0d2-4225-9dc9-7138daa7ecb2 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60a516ce54dca948df4efb3d5aa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a090198081045f0a7ad32c8c9898ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:34 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-cda17031-e0d2-4225-9dc9-7138daa7ecb2 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 200 len: 1237 microversion: 2.1 time: 0.167169 Apr 20 18:44:34 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:34 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 1237 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-584969487", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "dfac52da-60b6-4928-a243-f139eab2b8da"}], "security_groups": [{"name": "tempest-securitygroup--1308573209"}], "key_name": "tempest-keypair-372469975", "user_data": "}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:34 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] validate_networks() for [('dfac52da-60b6-4928-a243-f139eab2b8da', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for user 2c6275ba3d2249c7a04952e5726bb633 and project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:35 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:35 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-e8fa8cac-101f-448f-9de9-b67b3dccdd77 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.351506 Apr 20 18:44:35 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:34 2023] POST /compute/v2.1/servers => generated 400 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:35 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-4c30609e-4ee2-483e-bdd2-bc8b0cef177e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:35 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-4c30609e-4ee2-483e-bdd2-bc8b0cef177e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:36 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-4c30609e-4ee2-483e-bdd2-bc8b0cef177e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:36 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-4c30609e-4ee2-483e-bdd2-bc8b0cef177e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 200 len: 1234 microversion: 2.1 time: 0.286348 Apr 20 18:44:36 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:35 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 1234 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:37 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1431718713", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "481de45d-6902-4236-a7c2-94d498e10590"}], "security_groups": [{"name": "tempest-securitygroup--55938266"}], "key_name": "tempest-keypair-263672336", "user_data": "}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:37 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] validate_networks() for [('481de45d-6902-4236-a7c2-94d498e10590', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873ed527-b7b4-49d3-96b9-2268663c39b9", "tag": "032a5536-b87d-448c-b618-38d1b0c6b548"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:38 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Creating event network-changed:032a5536-b87d-448c-b618-38d1b0c6b548 for instance 873ed527-b7b4-49d3-96b9-2268663c39b9 on user Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61667) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ed0ef14b-17b8-468b-ae9f-cf08b2abaa76 req-390e3321-9385-4282-85bc-06389ea73cde service nova] Acquired lock "compute-rpcapi-router" {{(pid=61667) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:38 user devstack@n-api.service[61667]: INFO nova.compute.rpcapi [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 18:44:38 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] Releasing lock "compute-rpcapi-router" {{(pid=61667) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 18:44:38 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-46798ad5-fa0d-4e52-bce5-e6cec99ade10 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191220 Apr 20 18:44:38 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 20/59] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Getting quotas for project c72b0b62c9544459ab1fdac7a8938d13. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Getting quotas for user 700556715e4440448e91a864a0086e02 and project c72b0b62c9544459ab1fdac7a8938d13. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:40 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:40 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8ac87566-3cff-4bdc-b519-25a544b2378b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.716151 Apr 20 18:44:40 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 21/60] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:37 2023] POST /compute/v2.1/servers => generated 405 bytes in 3718 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:40 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-18c87868-9a20-4964-bb3d-8c9e7f8a87bd tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:40 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-18c87868-9a20-4964-bb3d-8c9e7f8a87bd tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:41 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-18c87868-9a20-4964-bb3d-8c9e7f8a87bd tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:41 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-18c87868-9a20-4964-bb3d-8c9e7f8a87bd tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1232 microversion: 2.1 time: 0.180463 Apr 20 18:44:41 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:40 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1232 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:42 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-c74ec6be-b75e-4718-9a2e-2e52d9188c11 req-71156a14-95d9-43f5-9f71-85876d547b62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0fc1158-1f40-4179-a8c6-b778f7e143bc", "tag": "26e3dc34-4770-481c-898f-4393bf682ab1"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-c74ec6be-b75e-4718-9a2e-2e52d9188c11 req-71156a14-95d9-43f5-9f71-85876d547b62 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-c74ec6be-b75e-4718-9a2e-2e52d9188c11 req-71156a14-95d9-43f5-9f71-85876d547b62 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-c74ec6be-b75e-4718-9a2e-2e52d9188c11 req-71156a14-95d9-43f5-9f71-85876d547b62 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:42 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-c74ec6be-b75e-4718-9a2e-2e52d9188c11 req-71156a14-95d9-43f5-9f71-85876d547b62 service nova] Creating event network-changed:26e3dc34-4770-481c-898f-4393bf682ab1 for instance b0fc1158-1f40-4179-a8c6-b778f7e143bc on user Apr 20 18:44:42 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-c74ec6be-b75e-4718-9a2e-2e52d9188c11 req-71156a14-95d9-43f5-9f71-85876d547b62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199068 Apr 20 18:44:42 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:45 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Creating event network-changed:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61666) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c5dc038a-dbba-41b2-ac6e-804f8db06da1 req-9450f43d-ae5d-4655-850a-042712128691 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61666) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:45 user devstack@n-api.service[61666]: INFO nova.compute.rpcapi [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 18:44:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] Releasing lock "compute-rpcapi-router" {{(pid=61666) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 18:44:45 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7cfbec97-302f-44b1-b429-d4935d74aea7 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128245 Apr 20 18:44:45 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 22/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fc1158-1f40-4179-a8c6-b778f7e143bc", "name": "network-vif-plugged", "status": "completed", "tag": "26e3dc34-4770-481c-898f-4393bf682ab1"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:46 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Creating event network-vif-plugged:26e3dc34-4770-481c-898f-4393bf682ab1 for instance b0fc1158-1f40-4179-a8c6-b778f7e143bc on user Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61668) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-46a91456-5a4c-477b-abde-eabe266c7e63 req-86b9c90c-c89e-4fb8-8c18-414799501e13 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61668) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:46 user devstack@n-api.service[61668]: INFO nova.compute.rpcapi [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 18:44:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] Releasing lock "compute-rpcapi-router" {{(pid=61668) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 18:44:46 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-168f0812-631d-4029-b516-60a4a80d67ab None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152481 Apr 20 18:44:46 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:47 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ed527-b7b4-49d3-96b9-2268663c39b9", "name": "network-vif-plugged", "status": "completed", "tag": "032a5536-b87d-448c-b618-38d1b0c6b548"}, {"name": "network-changed", "server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}, {"name": "network-changed", "server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}, {"server_uuid": "873ed527-b7b4-49d3-96b9-2268663c39b9", "name": "network-vif-plugged", "status": "completed", "tag": "032a5536-b87d-448c-b618-38d1b0c6b548"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:47 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=22 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Creating event network-vif-plugged:032a5536-b87d-448c-b618-38d1b0c6b548 for instance 873ed527-b7b4-49d3-96b9-2268663c39b9 on user Apr 20 18:44:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Creating event network-changed:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:44:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Creating event network-changed:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:44:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] Creating event network-vif-plugged:032a5536-b87d-448c-b618-38d1b0c6b548 for instance 873ed527-b7b4-49d3-96b9-2268663c39b9 on user Apr 20 18:44:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-5c0886e5-ed59-44d4-9aef-a283069ca5dc req-9c42fa83-ca1b-4f7c-8b33-ebb15020b33a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.063886 Apr 20 18:44:47 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 22/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:47 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:48 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fc1158-1f40-4179-a8c6-b778f7e143bc", "name": "network-vif-plugged", "status": "completed", "tag": "26e3dc34-4770-481c-898f-4393bf682ab1"}, {"name": "network-changed", "server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:48 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:48 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:48 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:48 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] Creating event network-vif-plugged:26e3dc34-4770-481c-898f-4393bf682ab1 for instance b0fc1158-1f40-4179-a8c6-b778f7e143bc on user Apr 20 18:44:48 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] Creating event network-changed:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:44:48 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-c4fed884-b39a-4b51-9c8b-7bdaa6058c10 req-bf25c50b-0394-408a-9776-41928cce9b5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064918 Apr 20 18:44:48 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:48 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:48 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-eef142e4-1537-48d9-87f5-12c255499715 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Action: 'create', calling method: .version_select at 0x7fe63ed00d30>, body: {"keypair": {"name": "tempest-keypair-1938327927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6uPTKd8fKWCVO2FWvJDEXoM+7G1yT//igtZsvm9pBDU4226dFJPcHKIGqCEV0606dP9g/Eg9Yu6AzNQjuK3SsHAXMIhgCO6m+MS+cNXGJwb9wC8xnkBbxmktwpTp0IUA=="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:48 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-eef142e4-1537-48d9-87f5-12c255499715 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Getting quotas for project e196bf571ed846339e119c1abdc7367e. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:48 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-eef142e4-1537-48d9-87f5-12c255499715 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Getting quotas for user 24f53ac3fb884290a0b57e68059bf789 and project e196bf571ed846339e119c1abdc7367e. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:48 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-eef142e4-1537-48d9-87f5-12c255499715 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315150 Apr 20 18:44:48 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:44:48 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:50 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-120851c3-c75b-4670-9206-2a6bbfd9ccfc req-8471015e-899a-4652-9633-e01027b5015a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "name": "network-vif-plugged", "status": "completed", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:50 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=8 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:50 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-120851c3-c75b-4670-9206-2a6bbfd9ccfc req-8471015e-899a-4652-9633-e01027b5015a service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:50 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-120851c3-c75b-4670-9206-2a6bbfd9ccfc req-8471015e-899a-4652-9633-e01027b5015a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:50 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-120851c3-c75b-4670-9206-2a6bbfd9ccfc req-8471015e-899a-4652-9633-e01027b5015a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:50 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-120851c3-c75b-4670-9206-2a6bbfd9ccfc req-8471015e-899a-4652-9633-e01027b5015a service nova] Creating event network-vif-plugged:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:44:50 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-120851c3-c75b-4670-9206-2a6bbfd9ccfc req-8471015e-899a-4652-9633-e01027b5015a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036292 Apr 20 18:44:50 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:52 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-c470ec38-a7e6-4e5d-88b2-3d4f756a8d74 req-94c96ead-0864-44fa-900b-69df51fcc3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "name": "network-vif-plugged", "status": "completed", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:52 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=18 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:52 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c470ec38-a7e6-4e5d-88b2-3d4f756a8d74 req-94c96ead-0864-44fa-900b-69df51fcc3b6 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:52 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c470ec38-a7e6-4e5d-88b2-3d4f756a8d74 req-94c96ead-0864-44fa-900b-69df51fcc3b6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:52 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c470ec38-a7e6-4e5d-88b2-3d4f756a8d74 req-94c96ead-0864-44fa-900b-69df51fcc3b6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:52 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-c470ec38-a7e6-4e5d-88b2-3d4f756a8d74 req-94c96ead-0864-44fa-900b-69df51fcc3b6 service nova] Creating event network-vif-plugged:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:44:52 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-c470ec38-a7e6-4e5d-88b2-3d4f756a8d74 req-94c96ead-0864-44fa-900b-69df51fcc3b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041235 Apr 20 18:44:52 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:53 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1883887182", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "1c05645d-d89d-44ec-ae4f-85522e5901a2"}], "security_groups": [{"name": "tempest-securitygroup--803899925"}], "key_name": "tempest-keypair-1938327927", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:54 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-0c42121e-ecfa-4f87-b21b-0c4eeb435a26 req-5766dc90-f100-4f35-a22f-642edd5d27a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-plugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:54 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] validate_networks() for [('1c05645d-d89d-44ec-ae4f-85522e5901a2', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:44:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-0c42121e-ecfa-4f87-b21b-0c4eeb435a26 req-5766dc90-f100-4f35-a22f-642edd5d27a1 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-0c42121e-ecfa-4f87-b21b-0c4eeb435a26 req-5766dc90-f100-4f35-a22f-642edd5d27a1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-0c42121e-ecfa-4f87-b21b-0c4eeb435a26 req-5766dc90-f100-4f35-a22f-642edd5d27a1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:54 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-0c42121e-ecfa-4f87-b21b-0c4eeb435a26 req-5766dc90-f100-4f35-a22f-642edd5d27a1 service nova] Creating event network-vif-plugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:44:54 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-0c42121e-ecfa-4f87-b21b-0c4eeb435a26 req-5766dc90-f100-4f35-a22f-642edd5d27a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143363 Apr 20 18:44:54 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:55 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:55 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=8 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-plugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}, {"server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "name": "network-vif-plugged", "status": "completed", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}, {"server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "name": "network-vif-plugged", "status": "completed", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:56 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:56 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Creating event network-vif-plugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:44:56 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Creating event network-vif-plugged:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:44:56 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] Creating event network-vif-plugged:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:44:56 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-86605e29-9156-444e-9799-700e3ea8b373 req-7708e93c-7882-4221-9c9b-b52fdfcbbb44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.131257 Apr 20 18:44:56 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:56 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:56 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-ec82dbb0-faad-41c0-8e27-e03064409768 req-b7b26eb9-17c5-41c3-ba6d-2ca33f0726de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "name": "network-vif-plugged", "status": "completed", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:56 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=10 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ec82dbb0-faad-41c0-8e27-e03064409768 req-b7b26eb9-17c5-41c3-ba6d-2ca33f0726de service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ec82dbb0-faad-41c0-8e27-e03064409768 req-b7b26eb9-17c5-41c3-ba6d-2ca33f0726de service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ec82dbb0-faad-41c0-8e27-e03064409768 req-b7b26eb9-17c5-41c3-ba6d-2ca33f0726de service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:56 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=19 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=8 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=25 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:44:56 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-ec82dbb0-faad-41c0-8e27-e03064409768 req-b7b26eb9-17c5-41c3-ba6d-2ca33f0726de service nova] Creating event network-vif-plugged:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:56 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-ec82dbb0-faad-41c0-8e27-e03064409768 req-b7b26eb9-17c5-41c3-ba6d-2ca33f0726de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059243 Apr 20 18:44:56 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Getting quotas for project e196bf571ed846339e119c1abdc7367e. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Getting quotas for user 24f53ac3fb884290a0b57e68059bf789 and project e196bf571ed846339e119c1abdc7367e. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:44:56 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:44:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f67f55cb-2726-437b-b4fa-5f7a12cdcd50 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 3.713108 Apr 20 18:44:57 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:44:53 2023] POST /compute/v2.1/servers => generated 403 bytes in 3715 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:44:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-4020f1e5-093d-4076-b82a-c75222a95007 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:44:57 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-4020f1e5-093d-4076-b82a-c75222a95007 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:44:57 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-4020f1e5-093d-4076-b82a-c75222a95007 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f53ac3fb884290a0b57e68059bf789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e196bf571ed846339e119c1abdc7367e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:44:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-4020f1e5-093d-4076-b82a-c75222a95007 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1" status: 200 len: 1236 microversion: 2.1 time: 0.284197 Apr 20 18:44:57 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 25/74] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:44:57 2023] GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1 => generated 1236 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:44:59 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-e503aa07-32e4-436f-877f-11fddbc53765 req-166a927c-6681-4e3c-898b-873109eb07e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "name": "network-vif-plugged", "status": "completed", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:44:59 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e503aa07-32e4-436f-877f-11fddbc53765 req-166a927c-6681-4e3c-898b-873109eb07e8 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:44:59 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e503aa07-32e4-436f-877f-11fddbc53765 req-166a927c-6681-4e3c-898b-873109eb07e8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:44:59 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e503aa07-32e4-436f-877f-11fddbc53765 req-166a927c-6681-4e3c-898b-873109eb07e8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:44:59 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-e503aa07-32e4-436f-877f-11fddbc53765 req-166a927c-6681-4e3c-898b-873109eb07e8 service nova] Creating event network-vif-plugged:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:44:59 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-e503aa07-32e4-436f-877f-11fddbc53765 req-166a927c-6681-4e3c-898b-873109eb07e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074115 Apr 20 18:44:59 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:44:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-8c00fdda-8152-4691-929f-03d6624909f8 req-44241a0d-3144-4e65-9bc6-20efaa8e3017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-8c00fdda-8152-4691-929f-03d6624909f8 req-44241a0d-3144-4e65-9bc6-20efaa8e3017 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-8c00fdda-8152-4691-929f-03d6624909f8 req-44241a0d-3144-4e65-9bc6-20efaa8e3017 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-8c00fdda-8152-4691-929f-03d6624909f8 req-44241a0d-3144-4e65-9bc6-20efaa8e3017 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-8c00fdda-8152-4691-929f-03d6624909f8 req-44241a0d-3144-4e65-9bc6-20efaa8e3017 service nova] Creating event network-changed:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:45:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-8c00fdda-8152-4691-929f-03d6624909f8 req-44241a0d-3144-4e65-9bc6-20efaa8e3017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166605 Apr 20 18:45:02 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:05 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-8926936b-f83c-40a1-bd1b-82d97a03c6b7 req-ecaa0764-b7b4-4472-abbb-1d623fc2bdae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "name": "network-vif-plugged", "status": "completed", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-8926936b-f83c-40a1-bd1b-82d97a03c6b7 req-ecaa0764-b7b4-4472-abbb-1d623fc2bdae service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-8926936b-f83c-40a1-bd1b-82d97a03c6b7 req-ecaa0764-b7b4-4472-abbb-1d623fc2bdae service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-8926936b-f83c-40a1-bd1b-82d97a03c6b7 req-ecaa0764-b7b4-4472-abbb-1d623fc2bdae service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:05 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-8926936b-f83c-40a1-bd1b-82d97a03c6b7 req-ecaa0764-b7b4-4472-abbb-1d623fc2bdae service nova] Creating event network-vif-plugged:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:45:05 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-8926936b-f83c-40a1-bd1b-82d97a03c6b7 req-ecaa0764-b7b4-4472-abbb-1d623fc2bdae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070162 Apr 20 18:45:05 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 26/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:45:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-363ce2f2-c960-4765-94e9-a14dcc862bc0 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Action: 'create', calling method: .version_select at 0x7fe63ed09630>, body: {"keypair": {"name": "tempest-keypair-725283097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOupVs3F57n23j+dZJ0K3i7utKIVVoNRqoMLQ55dSfkj3MOmPnk4HO3xS7WYly3Ot1qUEXD0BsI+MBMLpfYHMJ3HgWUKJZI/cNGaN+WgMLLbGYjRUaHfCTBhLHxHt4l11Q=="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:07 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-363ce2f2-c960-4765-94e9-a14dcc862bc0 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Getting quotas for project 75e72523e52246dbb13a936cafe97495. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:45:07 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-363ce2f2-c960-4765-94e9-a14dcc862bc0 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Getting quotas for user 58844c7c61ed40fd8251adfba29e5c24 and project 75e72523e52246dbb13a936cafe97495. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:45:07 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-363ce2f2-c960-4765-94e9-a14dcc862bc0 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.497184 Apr 20 18:45:07 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 27/78] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:45:06 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:07 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:07 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=5 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:07 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-ad65ab49-e381-4593-ae03-b20382dba085 req-9dfc319c-896c-42db-b827-ee112362b556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "name": "network-vif-plugged", "status": "completed", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:07 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-ad65ab49-e381-4593-ae03-b20382dba085 req-9dfc319c-896c-42db-b827-ee112362b556 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:07 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-ad65ab49-e381-4593-ae03-b20382dba085 req-9dfc319c-896c-42db-b827-ee112362b556 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:07 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-ad65ab49-e381-4593-ae03-b20382dba085 req-9dfc319c-896c-42db-b827-ee112362b556 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:07 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-ad65ab49-e381-4593-ae03-b20382dba085 req-9dfc319c-896c-42db-b827-ee112362b556 service nova] Creating event network-vif-plugged:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:45:07 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-ad65ab49-e381-4593-ae03-b20382dba085 req-9dfc319c-896c-42db-b827-ee112362b556 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166025 Apr 20 18:45:07 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 26/79] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:11 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1006735407", "imageRef": "b6596baa-0891-4cbf-a232-ca28c64973b3", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a0b74946-ac30-4b7a-845c-ebe2892cb2a9"}], "security_groups": [{"name": "tempest-securitygroup--1224365640"}], "key_name": "tempest-keypair-725283097", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:12 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] validate_networks() for [('a0b74946-ac30-4b7a-845c-ebe2892cb2a9', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Getting quotas for project 75e72523e52246dbb13a936cafe97495. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Getting quotas for user 58844c7c61ed40fd8251adfba29e5c24 and project 75e72523e52246dbb13a936cafe97495. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:45:13 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b6596baa-0891-4cbf-a232-ca28c64973b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:45:13 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-cbc91f0b-71a7-40a8-b6a3-162ef5f5f70b tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.812055 Apr 20 18:45:13 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 27/80] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:45:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:45:13 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-b2eb0c73-b5c3-4b51-906d-2019f7502f11 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:13 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-b2eb0c73-b5c3-4b51-906d-2019f7502f11 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:13 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:13 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-b2eb0c73-b5c3-4b51-906d-2019f7502f11 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58844c7c61ed40fd8251adfba29e5c24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e72523e52246dbb13a936cafe97495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:13 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-b2eb0c73-b5c3-4b51-906d-2019f7502f11 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 200 len: 1239 microversion: 2.1 time: 0.119514 Apr 20 18:45:13 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 28/81] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:13 2023] GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 1239 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-d1fd127c-6b54-4f9a-b24e-f62f6c00fe87 req-b060b95c-35cf-40b9-aa1d-86f3e84e6a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-d1fd127c-6b54-4f9a-b24e-f62f6c00fe87 req-b060b95c-35cf-40b9-aa1d-86f3e84e6a6c service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-d1fd127c-6b54-4f9a-b24e-f62f6c00fe87 req-b060b95c-35cf-40b9-aa1d-86f3e84e6a6c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-d1fd127c-6b54-4f9a-b24e-f62f6c00fe87 req-b060b95c-35cf-40b9-aa1d-86f3e84e6a6c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:17 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-d1fd127c-6b54-4f9a-b24e-f62f6c00fe87 req-b060b95c-35cf-40b9-aa1d-86f3e84e6a6c service nova] Creating event network-changed:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:45:17 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-d1fd127c-6b54-4f9a-b24e-f62f6c00fe87 req-b060b95c-35cf-40b9-aa1d-86f3e84e6a6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038053 Apr 20 18:45:17 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:19 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-67289e9c-c8fa-4be7-b816-7cbee781197d req-5dc1b801-e94a-4e4a-83dc-f33d9ba83d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "name": "network-vif-plugged", "status": "completed", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-67289e9c-c8fa-4be7-b816-7cbee781197d req-5dc1b801-e94a-4e4a-83dc-f33d9ba83d19 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-67289e9c-c8fa-4be7-b816-7cbee781197d req-5dc1b801-e94a-4e4a-83dc-f33d9ba83d19 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-67289e9c-c8fa-4be7-b816-7cbee781197d req-5dc1b801-e94a-4e4a-83dc-f33d9ba83d19 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:19 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=15 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-67289e9c-c8fa-4be7-b816-7cbee781197d req-5dc1b801-e94a-4e4a-83dc-f33d9ba83d19 service nova] Creating event network-vif-plugged:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:45:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-67289e9c-c8fa-4be7-b816-7cbee781197d req-5dc1b801-e94a-4e4a-83dc-f33d9ba83d19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037570 Apr 20 18:45:19 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:21 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-25c8be31-0660-4060-bf3a-e38ab9aefc97 req-c5323bf8-995e-44a9-93f8-4ea4ec52799e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "name": "network-vif-plugged", "status": "completed", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-25c8be31-0660-4060-bf3a-e38ab9aefc97 req-c5323bf8-995e-44a9-93f8-4ea4ec52799e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-25c8be31-0660-4060-bf3a-e38ab9aefc97 req-c5323bf8-995e-44a9-93f8-4ea4ec52799e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-25c8be31-0660-4060-bf3a-e38ab9aefc97 req-c5323bf8-995e-44a9-93f8-4ea4ec52799e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:22 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-25c8be31-0660-4060-bf3a-e38ab9aefc97 req-c5323bf8-995e-44a9-93f8-4ea4ec52799e service nova] Creating event network-vif-plugged:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:45:22 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-25c8be31-0660-4060-bf3a-e38ab9aefc97 req-c5323bf8-995e-44a9-93f8-4ea4ec52799e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053417 Apr 20 18:45:22 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:22 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d64688e63e442ae8202dfb4a9b0f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f36361a5645daa15f3a00fc385e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-9d838ac8-562d-402f-930d-a1eb733a798d tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc" status: 200 len: 1489 microversion: 2.1 time: 0.522652 Apr 20 18:45:22 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 28/85] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:22 2023] GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc => generated 1489 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:25 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60a516ce54dca948df4efb3d5aa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a090198081045f0a7ad32c8c9898ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:25 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-61b7645c-ea8c-4afe-9665-58e79e6e30dd tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 200 len: 1549 microversion: 2.1 time: 0.603598 Apr 20 18:45:25 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 30/86] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:24 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 1549 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:25 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-260aa9fe-4253-4a3f-808f-8c7a676ed069 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 200 len: 1503 microversion: 2.1 time: 0.749079 Apr 20 18:45:25 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 29/87] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:24 2023] GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 1503 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:25 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-a60b5874-7820-48bd-a96d-d8973c3aa0d8 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Action: 'create', calling method: .version_select at 0x7fe63ed03a30>, body: {"keypair": {"name": "tempest-keypair-1098022951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7eWPJi+TuPJP0vGgpsckctwuZS0qmlbQy1veZfRhRWDIwUFe2NlZk8l8purNh8l6pGA4pJeBZWX/cRNkdfWoMVriY5XxdmHz3BAX42B9ibOY7tgp7R4EgSuIiXXqvI5g=="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:25 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-a60b5874-7820-48bd-a96d-d8973c3aa0d8 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:45:25 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-a60b5874-7820-48bd-a96d-d8973c3aa0d8 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for user 10dd79d3683e4780b76f0f2d9b6aefae and project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:45:25 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-a60b5874-7820-48bd-a96d-d8973c3aa0d8 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179034 Apr 20 18:45:25 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:45:25 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:26 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-c37df661-736a-44e8-978a-2fa4c54ef9fd tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 200 len: 1545 microversion: 2.1 time: 0.502226 Apr 20 18:45:26 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:26 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 1545 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:45:28 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1983162761", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8db78bf5-b844-4675-800a-28a20b815045"}], "security_groups": [{"name": "tempest-securitygroup--1886773630"}], "key_name": "tempest-keypair-1098022951", "user_data": "}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:28 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:28 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] validate_networks() for [('8db78bf5-b844-4675-800a-28a20b815045', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:45:28 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2128417121", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "67b5a4a1-9752-474e-9443-28a98f95bd82"}]}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:28 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] validate_networks() for [('67b5a4a1-9752-474e-9443-28a98f95bd82', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for user 10dd79d3683e4780b76f0f2d9b6aefae and project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:45:29 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-f5f5b926-3a84-4576-b76f-01dad4af71f4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.211255 Apr 20 18:45:29 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 30/90] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:45:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:29 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-29cfe461-a0e3-447e-ae9f-7739c7b95fd4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:29 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-29cfe461-a0e3-447e-ae9f-7739c7b95fd4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:29 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=15 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Getting quotas for project 33f79038404f4e02974038c4e127abc6. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Getting quotas for user 8809171383a24c6d9c5b6d7185b59f8f and project 33f79038404f4e02974038c4e127abc6. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:45:29 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:45:29 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-29cfe461-a0e3-447e-ae9f-7739c7b95fd4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd79d3683e4780b76f0f2d9b6aefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eebb7c6a8414543b3d9c5830fddb2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:29 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-29cfe461-a0e3-447e-ae9f-7739c7b95fd4 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 200 len: 1232 microversion: 2.1 time: 0.072612 Apr 20 18:45:29 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 32/91] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:29 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 1232 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:29 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-2db1ac62-d568-4776-b73e-46bd62d2cbc2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.024148 Apr 20 18:45:29 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 30/92] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:45:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-e515eeb7-2e71-4e52-b3f9-be155239c305 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:29 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-e515eeb7-2e71-4e52-b3f9-be155239c305 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:30 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-e515eeb7-2e71-4e52-b3f9-be155239c305 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:30 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-e515eeb7-2e71-4e52-b3f9-be155239c305 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1211 microversion: 2.1 time: 0.096377 Apr 20 18:45:30 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 31/93] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:29 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:31 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:31 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-eb01949f-8011-4ac9-b45e-7c9ebcdc7bbf tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1537 microversion: 2.1 time: 0.359634 Apr 20 18:45:31 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 33/94] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:31 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1537 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:32 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-5ef66161-e7c3-41ea-b536-87d9926a2f3b req-5656573e-55fa-490e-8f93-d61c0182e029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-5ef66161-e7c3-41ea-b536-87d9926a2f3b req-5656573e-55fa-490e-8f93-d61c0182e029 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-5ef66161-e7c3-41ea-b536-87d9926a2f3b req-5656573e-55fa-490e-8f93-d61c0182e029 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-5ef66161-e7c3-41ea-b536-87d9926a2f3b req-5656573e-55fa-490e-8f93-d61c0182e029 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-5ef66161-e7c3-41ea-b536-87d9926a2f3b req-5656573e-55fa-490e-8f93-d61c0182e029 service nova] Creating event network-changed:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:45:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-5ef66161-e7c3-41ea-b536-87d9926a2f3b req-5656573e-55fa-490e-8f93-d61c0182e029 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030556 Apr 20 18:45:32 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:34 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-d233ae99-3a60-4519-bcb3-bbb9a9b02581 req-f24d9f87-80ef-45dc-827d-34fe87185fbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a9a1fc-a841-427c-90db-d910b4b21298", "tag": "519b4cb2-1e2f-4a23-8186-cd9f0e423527"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d233ae99-3a60-4519-bcb3-bbb9a9b02581 req-f24d9f87-80ef-45dc-827d-34fe87185fbc service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d233ae99-3a60-4519-bcb3-bbb9a9b02581 req-f24d9f87-80ef-45dc-827d-34fe87185fbc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d233ae99-3a60-4519-bcb3-bbb9a9b02581 req-f24d9f87-80ef-45dc-827d-34fe87185fbc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-d233ae99-3a60-4519-bcb3-bbb9a9b02581 req-f24d9f87-80ef-45dc-827d-34fe87185fbc service nova] Creating event network-changed:519b4cb2-1e2f-4a23-8186-cd9f0e423527 for instance 88a9a1fc-a841-427c-90db-d910b4b21298 on user Apr 20 18:45:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-d233ae99-3a60-4519-bcb3-bbb9a9b02581 req-f24d9f87-80ef-45dc-827d-34fe87185fbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039831 Apr 20 18:45:34 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:36 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "name": "network-vif-plugged", "status": "completed", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}, {"server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "name": "network-vif-plugged", "status": "completed", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:36 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:36 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:36 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:36 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] Creating event network-vif-plugged:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:45:36 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] Creating event network-vif-plugged:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:45:36 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-2034d251-554e-4e13-bea3-b1918ec5e516 req-8787348f-6730-4b0b-b5a1-3b6d964cc4d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043937 Apr 20 18:45:36 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 34/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:36 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:37 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-add3f093-28a6-428c-a4e4-7f8d3b556b72 req-5e8f393d-6e02-45c0-b88c-dd2e217a9aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9a1fc-a841-427c-90db-d910b4b21298", "name": "network-vif-plugged", "status": "completed", "tag": "519b4cb2-1e2f-4a23-8186-cd9f0e423527"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:37 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-add3f093-28a6-428c-a4e4-7f8d3b556b72 req-5e8f393d-6e02-45c0-b88c-dd2e217a9aa7 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:37 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-add3f093-28a6-428c-a4e4-7f8d3b556b72 req-5e8f393d-6e02-45c0-b88c-dd2e217a9aa7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:37 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-add3f093-28a6-428c-a4e4-7f8d3b556b72 req-5e8f393d-6e02-45c0-b88c-dd2e217a9aa7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:37 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-add3f093-28a6-428c-a4e4-7f8d3b556b72 req-5e8f393d-6e02-45c0-b88c-dd2e217a9aa7 service nova] Creating event network-vif-plugged:519b4cb2-1e2f-4a23-8186-cd9f0e423527 for instance 88a9a1fc-a841-427c-90db-d910b4b21298 on user Apr 20 18:45:37 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-add3f093-28a6-428c-a4e4-7f8d3b556b72 req-5e8f393d-6e02-45c0-b88c-dd2e217a9aa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048080 Apr 20 18:45:37 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:39 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-826efe3c-01c0-4972-b0a7-fb4d9b08098c req-8135db9c-fd39-4196-89b8-66da3ed2fdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9a1fc-a841-427c-90db-d910b4b21298", "name": "network-vif-plugged", "status": "completed", "tag": "519b4cb2-1e2f-4a23-8186-cd9f0e423527"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:39 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-826efe3c-01c0-4972-b0a7-fb4d9b08098c req-8135db9c-fd39-4196-89b8-66da3ed2fdf1 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:39 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-826efe3c-01c0-4972-b0a7-fb4d9b08098c req-8135db9c-fd39-4196-89b8-66da3ed2fdf1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:39 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-826efe3c-01c0-4972-b0a7-fb4d9b08098c req-8135db9c-fd39-4196-89b8-66da3ed2fdf1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:39 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-826efe3c-01c0-4972-b0a7-fb4d9b08098c req-8135db9c-fd39-4196-89b8-66da3ed2fdf1 service nova] Creating event network-vif-plugged:519b4cb2-1e2f-4a23-8186-cd9f0e423527 for instance 88a9a1fc-a841-427c-90db-d910b4b21298 on user Apr 20 18:45:39 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-826efe3c-01c0-4972-b0a7-fb4d9b08098c req-8135db9c-fd39-4196-89b8-66da3ed2fdf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Apr 20 18:45:39 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 33/99] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=7 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=22 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:47 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f53ac3fb884290a0b57e68059bf789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e196bf571ed846339e119c1abdc7367e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:47 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-c098e164-82d4-4b14-bd86-f2549c3caea0 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1" status: 200 len: 1544 microversion: 2.1 time: 0.362922 Apr 20 18:45:47 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 35/100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:45:47 2023] GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1 => generated 1544 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=10 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=5 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1066136613", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "507056ae-4667-4837-80d1-49f642249cfa"}]}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] validate_networks() for [('507056ae-4667-4837-80d1-49f642249cfa', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for user 1332e51aa657411cb00f200b592c39f1 and project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:45:52 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:45:52 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-6dc93c0c-c747-4f78-83fe-e2b4361a8ec0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.684990 Apr 20 18:45:52 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 33/101] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 18:45:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 18:45:52 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=8 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=13 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:45:52 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-a6aefddb-edae-4850-a33e-54592ce9159d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:45:52 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-a6aefddb-edae-4850-a33e-54592ce9159d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:45:53 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-a6aefddb-edae-4850-a33e-54592ce9159d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:53 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-a6aefddb-edae-4850-a33e-54592ce9159d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:53 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-a6aefddb-edae-4850-a33e-54592ce9159d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:45:53 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-a6aefddb-edae-4850-a33e-54592ce9159d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1" status: 200 len: 1395 microversion: 2.87 time: 0.085428 Apr 20 18:45:53 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 34/102] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:45:52 2023] GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 => generated 1395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:45:55 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-19e122a4-129a-4042-aaa5-df41caf6e26d req-ad4ac3f4-2a00-4175-a95b-03d6ccc8e7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f9a049b-d419-42e1-a458-41043de315f1", "tag": "fee6cd42-2ec5-48bb-9239-9754d05828b8"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:55 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-19e122a4-129a-4042-aaa5-df41caf6e26d req-ad4ac3f4-2a00-4175-a95b-03d6ccc8e7f5 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:55 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-19e122a4-129a-4042-aaa5-df41caf6e26d req-ad4ac3f4-2a00-4175-a95b-03d6ccc8e7f5 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:55 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-19e122a4-129a-4042-aaa5-df41caf6e26d req-ad4ac3f4-2a00-4175-a95b-03d6ccc8e7f5 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:55 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-19e122a4-129a-4042-aaa5-df41caf6e26d req-ad4ac3f4-2a00-4175-a95b-03d6ccc8e7f5 service nova] Creating event network-changed:fee6cd42-2ec5-48bb-9239-9754d05828b8 for instance 7f9a049b-d419-42e1-a458-41043de315f1 on user Apr 20 18:45:55 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-19e122a4-129a-4042-aaa5-df41caf6e26d req-ad4ac3f4-2a00-4175-a95b-03d6ccc8e7f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028602 Apr 20 18:45:55 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 36/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-4f6fa6d2-c69d-4736-a662-690993013f52 req-2b347025-ca89-4a6a-95ff-062d572aee86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9a049b-d419-42e1-a458-41043de315f1", "name": "network-vif-plugged", "status": "completed", "tag": "fee6cd42-2ec5-48bb-9239-9754d05828b8"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4f6fa6d2-c69d-4736-a662-690993013f52 req-2b347025-ca89-4a6a-95ff-062d572aee86 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4f6fa6d2-c69d-4736-a662-690993013f52 req-2b347025-ca89-4a6a-95ff-062d572aee86 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4f6fa6d2-c69d-4736-a662-690993013f52 req-2b347025-ca89-4a6a-95ff-062d572aee86 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-4f6fa6d2-c69d-4736-a662-690993013f52 req-2b347025-ca89-4a6a-95ff-062d572aee86 service nova] Creating event network-vif-plugged:fee6cd42-2ec5-48bb-9239-9754d05828b8 for instance 7f9a049b-d419-42e1-a458-41043de315f1 on user Apr 20 18:45:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-4f6fa6d2-c69d-4736-a662-690993013f52 req-2b347025-ca89-4a6a-95ff-062d572aee86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045743 Apr 20 18:45:57 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 34/104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:45:59 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-b629a2bd-9bd2-4929-a583-c75b9547d1cc req-45735cd5-dff6-49e2-aefc-ad4cca46bf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9a049b-d419-42e1-a458-41043de315f1", "name": "network-vif-plugged", "status": "completed", "tag": "fee6cd42-2ec5-48bb-9239-9754d05828b8"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:45:59 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-b629a2bd-9bd2-4929-a583-c75b9547d1cc req-45735cd5-dff6-49e2-aefc-ad4cca46bf62 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:45:59 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-b629a2bd-9bd2-4929-a583-c75b9547d1cc req-45735cd5-dff6-49e2-aefc-ad4cca46bf62 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:45:59 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-b629a2bd-9bd2-4929-a583-c75b9547d1cc req-45735cd5-dff6-49e2-aefc-ad4cca46bf62 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:45:59 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-b629a2bd-9bd2-4929-a583-c75b9547d1cc req-45735cd5-dff6-49e2-aefc-ad4cca46bf62 service nova] Creating event network-vif-plugged:fee6cd42-2ec5-48bb-9239-9754d05828b8 for instance 7f9a049b-d419-42e1-a458-41043de315f1 on user Apr 20 18:45:59 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-b629a2bd-9bd2-4929-a583-c75b9547d1cc req-45735cd5-dff6-49e2-aefc-ad4cca46bf62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Apr 20 18:45:59 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:45:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:04 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58844c7c61ed40fd8251adfba29e5c24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e72523e52246dbb13a936cafe97495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:04 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-14365073-68b2-418b-9f6b-1e10b5bee3a7 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 200 len: 1549 microversion: 2.1 time: 0.228523 Apr 20 18:46:04 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 37/106] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:03 2023] GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 1549 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=4 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=8 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:20 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd79d3683e4780b76f0f2d9b6aefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eebb7c6a8414543b3d9c5830fddb2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:20 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-df4b0916-4267-41e6-8374-b6d10c7b328b tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 200 len: 1538 microversion: 2.1 time: 0.768042 Apr 20 18:46:20 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:19 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 1538 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:20 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:20 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-7443beda-56de-4ab9-9f3f-5a17cb3401d2 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1494 microversion: 2.1 time: 0.708915 Apr 20 18:46:20 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:20 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1494 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=14 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:46:24 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-bea5a4c3-6a39-42ad-9358-5e509ad20ab4 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc" status: 204 len: 0 microversion: 2.1 time: 0.171284 Apr 20 18:46:24 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 38/109] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:46:24 2023] DELETE /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:24 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d64688e63e442ae8202dfb4a9b0f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e43f36361a5645daa15f3a00fc385e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-ebd7c1a9-0a44-4d55-bb63-b5ea060333a9 req-69de0669-4a88-4193-bd38-8ad50831bea0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fc1158-1f40-4179-a8c6-b778f7e143bc", "name": "network-vif-unplugged", "status": "completed", "tag": "26e3dc34-4770-481c-898f-4393bf682ab1"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:25 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-801cb377-5a5d-4ee7-8232-323d8baf27ba tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc" status: 200 len: 1495 microversion: 2.1 time: 0.277160 Apr 20 18:46:25 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 36/110] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:24 2023] GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc => generated 1495 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-ebd7c1a9-0a44-4d55-bb63-b5ea060333a9 req-69de0669-4a88-4193-bd38-8ad50831bea0 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-ebd7c1a9-0a44-4d55-bb63-b5ea060333a9 req-69de0669-4a88-4193-bd38-8ad50831bea0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-ebd7c1a9-0a44-4d55-bb63-b5ea060333a9 req-69de0669-4a88-4193-bd38-8ad50831bea0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-ebd7c1a9-0a44-4d55-bb63-b5ea060333a9 req-69de0669-4a88-4193-bd38-8ad50831bea0 service nova] Creating event network-vif-unplugged:26e3dc34-4770-481c-898f-4393bf682ab1 for instance b0fc1158-1f40-4179-a8c6-b778f7e143bc on user Apr 20 18:46:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-ebd7c1a9-0a44-4d55-bb63-b5ea060333a9 req-69de0669-4a88-4193-bd38-8ad50831bea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046847 Apr 20 18:46:25 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61666]: DEBUG nova.objects.instance [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lazy-loading 'flavor' on Instance uuid a0332417-891a-4c2a-bd86-b2fad86f7df9 {{(pid=61666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 18:46:25 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-27c1cd9a-0ac9-4e86-9e54-da3e98462fb8 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9/action" status: 200 len: 32 microversion: 2.1 time: 0.191207 Apr 20 18:46:25 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 37/112] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 18:46:25 2023] POST /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9/action => generated 32 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:25 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-7532abc6-f3b9-47d9-910e-4e2ed0d17a80 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.388491 Apr 20 18:46:25 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 39/113] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:46:25 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2/os-interface => generated 283 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:25 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-b50bfc1c-4f7a-4855-9221-a5e6e3f14d43 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 200 len: 1509 microversion: 2.1 time: 0.399181 Apr 20 18:46:25 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:25 2023] GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-2b8b4ac0-f1b0-4947-a82c-a07945043535 req-3987b209-204e-450c-9bf1-b54341a1a0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-unplugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-2b8b4ac0-f1b0-4947-a82c-a07945043535 req-3987b209-204e-450c-9bf1-b54341a1a0e3 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-2b8b4ac0-f1b0-4947-a82c-a07945043535 req-3987b209-204e-450c-9bf1-b54341a1a0e3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-2b8b4ac0-f1b0-4947-a82c-a07945043535 req-3987b209-204e-450c-9bf1-b54341a1a0e3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-2b8b4ac0-f1b0-4947-a82c-a07945043535 req-3987b209-204e-450c-9bf1-b54341a1a0e3 service nova] Creating event network-vif-unplugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:46:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-2b8b4ac0-f1b0-4947-a82c-a07945043535 req-3987b209-204e-450c-9bf1-b54341a1a0e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.248942 Apr 20 18:46:26 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:27 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-4fa848ac-1c90-4f5c-9c5a-db844f26ff42 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.165902 Apr 20 18:46:27 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:46:26 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654/os-interface => generated 283 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:27 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0fc1158-1f40-4179-a8c6-b778f7e143bc", "name": "network-vif-plugged", "status": "completed", "tag": "26e3dc34-4770-481c-898f-4393bf682ab1"}, {"server_uuid": "b0fc1158-1f40-4179-a8c6-b778f7e143bc", "name": "network-vif-deleted", "tag": "26e3dc34-4770-481c-898f-4393bf682ab1"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1050225962"}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:27 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] Creating event network-vif-plugged:26e3dc34-4770-481c-898f-4393bf682ab1 for instance b0fc1158-1f40-4179-a8c6-b778f7e143bc on user Apr 20 18:46:27 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] Creating event network-vif-deleted:26e3dc34-4770-481c-898f-4393bf682ab1 for instance b0fc1158-1f40-4179-a8c6-b778f7e143bc on user Apr 20 18:46:27 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-5dd15496-d96c-42af-8821-767deaa38a7c req-dd622439-a904-4260-8467-1801ec7dfbab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040057 Apr 20 18:46:27 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 39/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:27 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-dbfaedf0-c420-421d-a2f2-b17563e1822e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2/action" status: 202 len: 0 microversion: 2.1 time: 0.861449 Apr 20 18:46:27 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 39/118] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 18:46:27 2023] POST /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2/action => generated 0 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 18:46:27 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a78de1f7-60f5-4d6b-8ff1-86da21e87891 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '.version_select at 0x7fe63edc9fc0>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:27 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a78de1f7-60f5-4d6b-8ff1-86da21e87891 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f" status: 200 len: 1611 microversion: 2.1 time: 0.065053 Apr 20 18:46:27 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 41/119] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 18:46:27 2023] GET /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f => generated 1611 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:28 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-73da4d96-de9b-4253-84d3-0b7e070f35f1 req-8e8c5f82-6438-4b61-8196-6b560d98ab91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-73da4d96-de9b-4253-84d3-0b7e070f35f1 req-8e8c5f82-6438-4b61-8196-6b560d98ab91 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-73da4d96-de9b-4253-84d3-0b7e070f35f1 req-8e8c5f82-6438-4b61-8196-6b560d98ab91 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-73da4d96-de9b-4253-84d3-0b7e070f35f1 req-8e8c5f82-6438-4b61-8196-6b560d98ab91 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:28 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-73da4d96-de9b-4253-84d3-0b7e070f35f1 req-8e8c5f82-6438-4b61-8196-6b560d98ab91 service nova] Creating event network-changed:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:46:28 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-73da4d96-de9b-4253-84d3-0b7e070f35f1 req-8e8c5f82-6438-4b61-8196-6b560d98ab91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054906 Apr 20 18:46:28 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 40/120] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-e0dee35d-92da-4630-ae3e-2c83edd57dda tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654/ips" status: 200 len: 109 microversion: 2.1 time: 0.039396 Apr 20 18:46:28 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 40/121] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:46:28 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:28 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}, {"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-plugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}, {"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-plugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:28 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Creating event network-changed:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:46:28 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Creating event network-vif-plugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:46:28 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] Creating event network-vif-plugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:46:28 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-333c0986-f824-4f86-b9f4-b0f4045ec0c9 req-8bef1d14-c665-44c0-a837-e7a16a090eba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.044137 Apr 20 18:46:28 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:28 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:30 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:46:30 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-324a4e6f-4334-45d4-85a6-f834fc47eede tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 204 len: 0 microversion: 2.1 time: 0.184892 Apr 20 18:46:30 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 41/123] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:46:30 2023] DELETE /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:30 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:30 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-61ad0673-986e-4d02-9707-3ffdb59ae27f tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 200 len: 1668 microversion: 2.1 time: 0.358438 Apr 20 18:46:30 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:30 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 1668 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:30 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-934b2eb8-7fc7-4dc5-9c4e-d07f07655280 req-18cdc8d5-cfb4-492d-95d9-9156dc071b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "name": "network-vif-unplugged", "status": "completed", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:30 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-934b2eb8-7fc7-4dc5-9c4e-d07f07655280 req-18cdc8d5-cfb4-492d-95d9-9156dc071b14 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:30 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-934b2eb8-7fc7-4dc5-9c4e-d07f07655280 req-18cdc8d5-cfb4-492d-95d9-9156dc071b14 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:30 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-934b2eb8-7fc7-4dc5-9c4e-d07f07655280 req-18cdc8d5-cfb4-492d-95d9-9156dc071b14 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:30 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-934b2eb8-7fc7-4dc5-9c4e-d07f07655280 req-18cdc8d5-cfb4-492d-95d9-9156dc071b14 service nova] Creating event network-vif-unplugged:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:46:30 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-934b2eb8-7fc7-4dc5-9c4e-d07f07655280 req-18cdc8d5-cfb4-492d-95d9-9156dc071b14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029450 Apr 20 18:46:30 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 43/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:31 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-a5bc98a9-b57f-44df-b1fc-b0a8c3f4160f req-9a6316df-28a6-4b16-b2b6-92588c85f573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-plugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a5bc98a9-b57f-44df-b1fc-b0a8c3f4160f req-9a6316df-28a6-4b16-b2b6-92588c85f573 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a5bc98a9-b57f-44df-b1fc-b0a8c3f4160f req-9a6316df-28a6-4b16-b2b6-92588c85f573 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a5bc98a9-b57f-44df-b1fc-b0a8c3f4160f req-9a6316df-28a6-4b16-b2b6-92588c85f573 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:31 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-a5bc98a9-b57f-44df-b1fc-b0a8c3f4160f req-9a6316df-28a6-4b16-b2b6-92588c85f573 service nova] Creating event network-vif-plugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:46:31 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-a5bc98a9-b57f-44df-b1fc-b0a8c3f4160f req-9a6316df-28a6-4b16-b2b6-92588c85f573 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048037 Apr 20 18:46:31 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 42/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:31 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-3f59fc86-03cf-4ff9-9114-d5eddb29ebe0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.169069 Apr 20 18:46:31 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 42/127] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:46:31 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c/os-interface => generated 283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-16f797cb-e2aa-4da6-a5cf-37e7726c3528 req-752997f1-c6f8-4909-b785-91caf2ac62a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "name": "network-vif-deleted", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-16f797cb-e2aa-4da6-a5cf-37e7726c3528 req-752997f1-c6f8-4909-b785-91caf2ac62a6 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-16f797cb-e2aa-4da6-a5cf-37e7726c3528 req-752997f1-c6f8-4909-b785-91caf2ac62a6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-16f797cb-e2aa-4da6-a5cf-37e7726c3528 req-752997f1-c6f8-4909-b785-91caf2ac62a6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:32 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-16f797cb-e2aa-4da6-a5cf-37e7726c3528 req-752997f1-c6f8-4909-b785-91caf2ac62a6 service nova] Creating event network-vif-deleted:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:46:32 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-16f797cb-e2aa-4da6-a5cf-37e7726c3528 req-752997f1-c6f8-4909-b785-91caf2ac62a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054027 Apr 20 18:46:32 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:32 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56c0610-41b7-4083-9673-698c0acad654", "name": "network-vif-plugged", "status": "completed", "tag": "fa165416-dea1-43eb-a522-05dbb01f0206"}, {"name": "network-changed", "server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] Creating event network-vif-plugged:fa165416-dea1-43eb-a522-05dbb01f0206 for instance d56c0610-41b7-4083-9673-698c0acad654 on user Apr 20 18:46:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] Creating event network-changed:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-4f0737a1-a690-4cb0-b5a9-d3ee37ffc20d req-dc341327-6e55-4237-9199-83f06fc30d26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.043062 Apr 20 18:46:32 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:32 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:46:32 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-c8f885a8-7161-4088-8007-84fe156e8cd7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1537 microversion: 2.1 time: 0.183578 Apr 20 18:46:32 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:32 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:33 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:33 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-cc74bec6-8e77-4c14-b82c-69bb3d220a87 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1537 microversion: 2.1 time: 0.425305 Apr 20 18:46:33 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 45/131] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:32 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1537 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:43 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:43 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-5d969c5d-3409-497a-8ced-179d8a3aba77 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1" status: 200 len: 1690 microversion: 2.87 time: 0.620441 Apr 20 18:46:43 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 44/132] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:46:43 2023] GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 => generated 1690 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=18 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:47 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:48 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f9ca94a6-2a78-4672-b50d-75f271cc86b3 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171590 Apr 20 18:46:48 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:46:47 2023] GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:48 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-efe238dd-6a7e-4554-b8b4-4531b64b096a req-f4fb95e5-c79c-4316-88f9-b32eb187529c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:48 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:48 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:46:48 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-efe238dd-6a7e-4554-b8b4-4531b64b096a req-f4fb95e5-c79c-4316-88f9-b32eb187529c service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:48 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-efe238dd-6a7e-4554-b8b4-4531b64b096a req-f4fb95e5-c79c-4316-88f9-b32eb187529c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:48 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-efe238dd-6a7e-4554-b8b4-4531b64b096a req-f4fb95e5-c79c-4316-88f9-b32eb187529c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:48 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-efe238dd-6a7e-4554-b8b4-4531b64b096a req-f4fb95e5-c79c-4316-88f9-b32eb187529c service nova] Creating event network-changed:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:46:48 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-efe238dd-6a7e-4554-b8b4-4531b64b096a req-f4fb95e5-c79c-4316-88f9-b32eb187529c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 Apr 20 18:46:48 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 46/134] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-960433242", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "1c05645d-d89d-44ec-ae4f-85522e5901a2"}]}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] validate_networks() for [('1c05645d-d89d-44ec-ae4f-85522e5901a2', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Getting quotas for project e196bf571ed846339e119c1abdc7367e. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Getting quotas for user 24f53ac3fb884290a0b57e68059bf789 and project e196bf571ed846339e119c1abdc7367e. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:46:50 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:46:50 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-9cb6e7ca-7b6f-4507-8059-a56da05b97a9 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.544687 Apr 20 18:46:50 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 45/135] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:46:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:46:50 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-31d1337a-8abe-4786-b4aa-1d6ce0fe38cb tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:46:50 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-31d1337a-8abe-4786-b4aa-1d6ce0fe38cb tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:46:50 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-31d1337a-8abe-4786-b4aa-1d6ce0fe38cb tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f53ac3fb884290a0b57e68059bf789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e196bf571ed846339e119c1abdc7367e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:46:50 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-31d1337a-8abe-4786-b4aa-1d6ce0fe38cb tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c" status: 200 len: 1211 microversion: 2.1 time: 0.066786 Apr 20 18:46:50 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:46:50 2023] GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c => generated 1211 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:46:53 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-fd2f13b6-742b-42ce-b85e-1e4466724671 req-e6b44d70-14a9-4fe9-acb1-d062c98445f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a235505e-9475-4676-80db-0aef8e52a34c", "tag": "8a394d73-7929-4f4e-908b-a779e6683c59"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:53 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-fd2f13b6-742b-42ce-b85e-1e4466724671 req-e6b44d70-14a9-4fe9-acb1-d062c98445f0 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:53 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-fd2f13b6-742b-42ce-b85e-1e4466724671 req-e6b44d70-14a9-4fe9-acb1-d062c98445f0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:53 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-fd2f13b6-742b-42ce-b85e-1e4466724671 req-e6b44d70-14a9-4fe9-acb1-d062c98445f0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:53 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-fd2f13b6-742b-42ce-b85e-1e4466724671 req-e6b44d70-14a9-4fe9-acb1-d062c98445f0 service nova] Creating event network-changed:8a394d73-7929-4f4e-908b-a779e6683c59 for instance a235505e-9475-4676-80db-0aef8e52a34c on user Apr 20 18:46:53 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-fd2f13b6-742b-42ce-b85e-1e4466724671 req-e6b44d70-14a9-4fe9-acb1-d062c98445f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038491 Apr 20 18:46:53 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:46:55 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-0cd77c45-e5c6-42fc-b501-cf95f2db597c req-20c2422f-e25e-4cfc-9929-39030d712ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a235505e-9475-4676-80db-0aef8e52a34c", "name": "network-vif-plugged", "status": "completed", "tag": "8a394d73-7929-4f4e-908b-a779e6683c59"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:55 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-0cd77c45-e5c6-42fc-b501-cf95f2db597c req-20c2422f-e25e-4cfc-9929-39030d712ae8 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:55 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-0cd77c45-e5c6-42fc-b501-cf95f2db597c req-20c2422f-e25e-4cfc-9929-39030d712ae8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:55 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-0cd77c45-e5c6-42fc-b501-cf95f2db597c req-20c2422f-e25e-4cfc-9929-39030d712ae8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:55 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-0cd77c45-e5c6-42fc-b501-cf95f2db597c req-20c2422f-e25e-4cfc-9929-39030d712ae8 service nova] Creating event network-vif-plugged:8a394d73-7929-4f4e-908b-a779e6683c59 for instance a235505e-9475-4676-80db-0aef8e52a34c on user Apr 20 18:46:55 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-0cd77c45-e5c6-42fc-b501-cf95f2db597c req-20c2422f-e25e-4cfc-9929-39030d712ae8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064600 Apr 20 18:46:55 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 46/138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 18:46:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-1d42e739-cd78-4375-abf0-ad2746b6f587 req-23df3d11-5a9a-41f2-96f4-1cde29915e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a235505e-9475-4676-80db-0aef8e52a34c", "name": "network-vif-plugged", "status": "completed", "tag": "8a394d73-7929-4f4e-908b-a779e6683c59"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:46:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-1d42e739-cd78-4375-abf0-ad2746b6f587 req-23df3d11-5a9a-41f2-96f4-1cde29915e86 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:46:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-1d42e739-cd78-4375-abf0-ad2746b6f587 req-23df3d11-5a9a-41f2-96f4-1cde29915e86 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:46:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-1d42e739-cd78-4375-abf0-ad2746b6f587 req-23df3d11-5a9a-41f2-96f4-1cde29915e86 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:46:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-1d42e739-cd78-4375-abf0-ad2746b6f587 req-23df3d11-5a9a-41f2-96f4-1cde29915e86 service nova] Creating event network-vif-plugged:8a394d73-7929-4f4e-908b-a779e6683c59 for instance a235505e-9475-4676-80db-0aef8e52a34c on user Apr 20 18:46:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-1d42e739-cd78-4375-abf0-ad2746b6f587 req-23df3d11-5a9a-41f2-96f4-1cde29915e86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029054 Apr 20 18:46:57 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:46:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:04 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-076fba4b-22f2-4a0f-ad01-1b1aea16999a tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.162361 Apr 20 18:47:04 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:47:04 2023] GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-d3b2dde6-9fb0-452e-8248-140d90b447b2 req-331137aa-eeb8-4500-9fdb-e4b5939a1dba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=10 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3b2dde6-9fb0-452e-8248-140d90b447b2 req-331137aa-eeb8-4500-9fdb-e4b5939a1dba service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3b2dde6-9fb0-452e-8248-140d90b447b2 req-331137aa-eeb8-4500-9fdb-e4b5939a1dba service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3b2dde6-9fb0-452e-8248-140d90b447b2 req-331137aa-eeb8-4500-9fdb-e4b5939a1dba service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:05 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-d3b2dde6-9fb0-452e-8248-140d90b447b2 req-331137aa-eeb8-4500-9fdb-e4b5939a1dba service nova] Creating event network-changed:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:47:05 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-d3b2dde6-9fb0-452e-8248-140d90b447b2 req-331137aa-eeb8-4500-9fdb-e4b5939a1dba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052503 Apr 20 18:47:05 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 47/141] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:06 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:47:07 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-4e15f5a9-23a6-4b7e-9342-5c11e1aa7602 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 204 len: 0 microversion: 2.1 time: 0.119894 Apr 20 18:47:07 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:47:06 2023] DELETE /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:07 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58844c7c61ed40fd8251adfba29e5c24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e72523e52246dbb13a936cafe97495', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:07 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-74e8c79a-0ea9-4ddd-b2df-fae8d735a7d8 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 200 len: 1673 microversion: 2.1 time: 0.158959 Apr 20 18:47:07 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 49/143] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:07 2023] GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:07 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-b5346720-c231-4e01-8077-9389838a44ac req-5abc3c70-cafe-4a3c-b74d-5956a69fe58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "name": "network-vif-unplugged", "status": "completed", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:07 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-b5346720-c231-4e01-8077-9389838a44ac req-5abc3c70-cafe-4a3c-b74d-5956a69fe58a service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:07 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-b5346720-c231-4e01-8077-9389838a44ac req-5abc3c70-cafe-4a3c-b74d-5956a69fe58a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:07 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-b5346720-c231-4e01-8077-9389838a44ac req-5abc3c70-cafe-4a3c-b74d-5956a69fe58a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:07 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-b5346720-c231-4e01-8077-9389838a44ac req-5abc3c70-cafe-4a3c-b74d-5956a69fe58a service nova] Creating event network-vif-unplugged:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:47:07 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-b5346720-c231-4e01-8077-9389838a44ac req-5abc3c70-cafe-4a3c-b74d-5956a69fe58a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036515 Apr 20 18:47:07 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 48/144] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-a78ca3bc-9914-41a5-9b44-44a23a496496 req-f1fba4f3-0be8-4a10-a465-26213de9ee0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "name": "network-vif-deleted", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-a78ca3bc-9914-41a5-9b44-44a23a496496 req-f1fba4f3-0be8-4a10-a465-26213de9ee0b service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-a78ca3bc-9914-41a5-9b44-44a23a496496 req-f1fba4f3-0be8-4a10-a465-26213de9ee0b service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-a78ca3bc-9914-41a5-9b44-44a23a496496 req-f1fba4f3-0be8-4a10-a465-26213de9ee0b service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-a78ca3bc-9914-41a5-9b44-44a23a496496 req-f1fba4f3-0be8-4a10-a465-26213de9ee0b service nova] Creating event network-vif-deleted:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:47:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-a78ca3bc-9914-41a5-9b44-44a23a496496 req-f1fba4f3-0be8-4a10-a465-26213de9ee0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029420 Apr 20 18:47:08 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:09 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-7131aedc-c29e-4d1a-8ed2-fb39a82f0b4a req-d5ab31e5-8f17-4521-99ed-3d76acc2ba4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccb481e-a0af-4275-81a0-0ca282ae5737", "name": "network-vif-plugged", "status": "completed", "tag": "3c25aa90-7f4b-46a0-960d-7e452573fe44"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:09 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-7131aedc-c29e-4d1a-8ed2-fb39a82f0b4a req-d5ab31e5-8f17-4521-99ed-3d76acc2ba4a service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:09 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-7131aedc-c29e-4d1a-8ed2-fb39a82f0b4a req-d5ab31e5-8f17-4521-99ed-3d76acc2ba4a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:09 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-7131aedc-c29e-4d1a-8ed2-fb39a82f0b4a req-d5ab31e5-8f17-4521-99ed-3d76acc2ba4a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:09 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-7131aedc-c29e-4d1a-8ed2-fb39a82f0b4a req-d5ab31e5-8f17-4521-99ed-3d76acc2ba4a service nova] Creating event network-vif-plugged:3c25aa90-7f4b-46a0-960d-7e452573fe44 for instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 on user Apr 20 18:47:09 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-7131aedc-c29e-4d1a-8ed2-fb39a82f0b4a req-d5ab31e5-8f17-4521-99ed-3d76acc2ba4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029675 Apr 20 18:47:09 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] [instance: b0fc1158-1f40-4179-a8c6-b778f7e143bc] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] HTTP exception thrown: Instance b0fc1158-1f40-4179-a8c6-b778f7e143bc could not be found. Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Request method failure captured: Apr 20 18:47:15 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc HTTP/1.1 Apr 20 18:47:15 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:47:15 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:47:15 user devstack@n-api.service[61668]: Connection: close Apr 20 18:47:15 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:47:15 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:47:15 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:47:15 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:47:15 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgMmvP67GWwCaq9tHzGNr9z_ZAQZokTJFCARjF8OzLjcRvGG6lgA-zURylesbs5K4wLW8xpFoLgINPcv5ZlGX7BgiUvzoJBFlDP_p-Qj4pntghMvMoytAVGM4leLQtzNcIHoQxw6sTUuUz6EMQLHGaZWqoYFYVP-AOslXXRmb4HVUE Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Project-Id: e43f36361a5645daa15f3a00fc385e4d Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Project-Name: tempest-DeleteServersTestJSON-1257816065 Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e43f36361a5645daa15f3a00fc385e4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e43f36361a5645daa15f3a00fc385e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e43f36361a5645daa15f3a00fc385e4d"}]}] Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Tenant: tempest-DeleteServersTestJSON-1257816065 Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Tenant-Id: e43f36361a5645daa15f3a00fc385e4d Apr 20 18:47:15 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-DeleteServersTestJSON-1257816065 Apr 20 18:47:15 user devstack@n-api.service[61668]: X-User: tempest-DeleteServersTestJSON-1257816065-project-member Apr 20 18:47:15 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:47:15 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:47:15 user devstack@n-api.service[61668]: X-User-Id: 3d64688e63e442ae8202dfb4a9b0f391 Apr 20 18:47:15 user devstack@n-api.service[61668]: X-User-Name: tempest-DeleteServersTestJSON-1257816065-project-member Apr 20 18:47:15 user devstack@n-api.service[61668]: method: > Apr 20 18:47:15 user devstack@n-api.service[61668]: exception: Instance b0fc1158-1f40-4179-a8c6-b778f7e143bc could not be found. Apr 20 18:47:15 user devstack@n-api.service[61668]: action_args: {'id': 'b0fc1158-1f40-4179-a8c6-b778f7e143bc'} Apr 20 18:47:15 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0fc1158-1f40-4179-a8c6-b778f7e143bc could not be found. Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0fc1158-1f40-4179-a8c6-b778f7e143bc could not be found. Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0fc1158-1f40-4179-a8c6-b778f7e143bc could not be found. Apr 20 18:47:15 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:15 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] Returning 404 to user: Instance b0fc1158-1f40-4179-a8c6-b778f7e143bc could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:47:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-797f2546-54c7-4cbc-ba35-df6103158c13 tempest-DeleteServersTestJSON-1257816065 tempest-DeleteServersTestJSON-1257816065-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc" status: 404 len: 111 microversion: 2.1 time: 0.045116 Apr 20 18:47:15 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:15 2023] GET /compute/v2.1/servers/b0fc1158-1f40-4179-a8c6-b778f7e143bc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:16 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:16 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-08e878b1-2e1d-43ae-aae3-6913c82cec03 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 200 len: 1489 microversion: 2.1 time: 0.233085 Apr 20 18:47:16 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:15 2023] GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 1489 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:18 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6302f52e-1866-47ff-b4a3-4d9831399bff tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '.version_select at 0x7fe63ed41510>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:18 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-6302f52e-1866-47ff-b4a3-4d9831399bff tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f" status: 200 len: 1725 microversion: 2.1 time: 0.053032 Apr 20 18:47:18 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 18:47:18 2023] GET /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f => generated 1725 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:18 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-70b8fdf8-910a-4c37-82af-c5c549510885 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '.version_select at 0x7fe63ea3c160>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:18 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-70b8fdf8-910a-4c37-82af-c5c549510885 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f" status: 200 len: 1725 microversion: 2.1 time: 0.059145 Apr 20 18:47:18 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 18:47:18 2023] GET /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f => generated 1725 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:18 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60a516ce54dca948df4efb3d5aa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a090198081045f0a7ad32c8c9898ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:18 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7ccf067d-41bb-429c-a361-3e0579d5fd33 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 200 len: 1668 microversion: 2.1 time: 0.240825 Apr 20 18:47:18 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:18 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=12 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:47:20 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 HTTP/1.1 Apr 20 18:47:20 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:47:20 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:47:20 user devstack@n-api.service[61667]: Connection: close Apr 20 18:47:20 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:47:20 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:47:20 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:47:20 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:47:20 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:47:20 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:47:20 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:47:20 user devstack@n-api.service[61667]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:47:20 user devstack@n-api.service[61667]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:47:20 user devstack@n-api.service[61667]: method: > Apr 20 18:47:20 user devstack@n-api.service[61667]: exception: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:47:20 user devstack@n-api.service[61667]: action_args: {'id': 'd56c0610-41b7-4083-9673-698c0acad654'} Apr 20 18:47:20 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:47:20 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:47:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-e2385ff7-9c2d-4be2-a743-f38108004f44 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 404 len: 111 microversion: 2.1 time: 0.040146 Apr 20 18:47:20 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 52/152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:20 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:20 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-0b3f85ef-3136-436e-a12b-4c289300e212 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '.version_select at 0x7fe63ed59b40>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:20 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-0b3f85ef-3136-436e-a12b-4c289300e212 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372469975" status: 202 len: 0 microversion: 2.1 time: 0.022696 Apr 20 18:47:20 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:47:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372469975 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:47:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-405714113", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "67b5a4a1-9752-474e-9443-28a98f95bd82"}]}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:20 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-ca32127a-7904-4fb6-90ab-63991c07c15f tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.174680 Apr 20 18:47:20 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 51/154] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:47:20 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9/os-interface => generated 282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] validate_networks() for [('67b5a4a1-9752-474e-9443-28a98f95bd82', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Getting quotas for project 33f79038404f4e02974038c4e127abc6. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Getting quotas for user 8809171383a24c6d9c5b6d7185b59f8f and project 33f79038404f4e02974038c4e127abc6. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:47:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-560f0c72-8fff-42df-be26-28e78a3abcc0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.656954 Apr 20 18:47:21 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 53/155] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:47:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:47:21 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7b4d3b0f-82e8-4053-90a1-a3b42d463769 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:21 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7b4d3b0f-82e8-4053-90a1-a3b42d463769 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:21 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-4695f76d-7426-4c31-9208-21b8e5180ed6 req-66c0e935-e780-4969-9108-3cc54e8c4cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4695f76d-7426-4c31-9208-21b8e5180ed6 req-66c0e935-e780-4969-9108-3cc54e8c4cd8 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4695f76d-7426-4c31-9208-21b8e5180ed6 req-66c0e935-e780-4969-9108-3cc54e8c4cd8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4695f76d-7426-4c31-9208-21b8e5180ed6 req-66c0e935-e780-4969-9108-3cc54e8c4cd8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:21 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-4695f76d-7426-4c31-9208-21b8e5180ed6 req-66c0e935-e780-4969-9108-3cc54e8c4cd8 service nova] Creating event network-changed:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:47:21 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-4695f76d-7426-4c31-9208-21b8e5180ed6 req-66c0e935-e780-4969-9108-3cc54e8c4cd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042590 Apr 20 18:47:21 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 52/156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-516464a7-00e9-484f-b968-24222c4bb061 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9/ips" status: 200 len: 104 microversion: 2.1 time: 0.035499 Apr 20 18:47:21 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 54/157] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:47:21 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9/ips => generated 104 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:22 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-7b4d3b0f-82e8-4053-90a1-a3b42d463769 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7b4d3b0f-82e8-4053-90a1-a3b42d463769 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 200 len: 1210 microversion: 2.1 time: 0.529210 Apr 20 18:47:22 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:21 2023] GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 1210 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:22 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6523a9c3-5783-4474-86a3-cb457a55a3a3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Action: 'create', calling method: .version_select at 0x7fe640030790>, body: {"keypair": {"name": "tempest-keypair-1487550582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKqIT9JfOeyQMPmWKEeYJRahKyscLi0B1Vhve+XBXe6g8/wgEmxteGPN7STvTNuNM4MJ+gir83DjYecuAJO+RirNbgYLSulmMeCyqRgWZMCoRGgew983BWJojPLnDbu2w=="}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:22 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-6523a9c3-5783-4474-86a3-cb457a55a3a3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:47:22 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-6523a9c3-5783-4474-86a3-cb457a55a3a3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for user 2c6275ba3d2249c7a04952e5726bb633 and project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:47:22 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-6523a9c3-5783-4474-86a3-cb457a55a3a3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047880 Apr 20 18:47:22 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:47:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:47:23 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-57a48f0e-c5b0-412c-8dc2-06b2bdf7bba6 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 204 len: 0 microversion: 2.1 time: 0.132331 Apr 20 18:47:23 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 55/160] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:47:23 2023] DELETE /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd79d3683e4780b76f0f2d9b6aefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eebb7c6a8414543b3d9c5830fddb2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:23 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-45a82a59-5001-4df0-8582-d9c49cc9a5bc tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 200 len: 1663 microversion: 2.1 time: 0.357326 Apr 20 18:47:23 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:23 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 1663 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:23 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1075059087", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "dfac52da-60b6-4928-a243-f139eab2b8da"}], "security_groups": [{"name": "tempest-securitygroup--1328456037"}], "key_name": "tempest-keypair-1487550582", "user_data": "}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:23 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d8e9c217-9186-4575-aaf3-dd6a8808457a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.475157 Apr 20 18:47:23 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:23 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-ea0dcfb6-e978-4254-92aa-befc3b87de8c req-720e2c00-d9e2-45d2-b1d1-efe555515cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "name": "network-vif-unplugged", "status": "completed", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-ea0dcfb6-e978-4254-92aa-befc3b87de8c req-720e2c00-d9e2-45d2-b1d1-efe555515cdf service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-ea0dcfb6-e978-4254-92aa-befc3b87de8c req-720e2c00-d9e2-45d2-b1d1-efe555515cdf service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-ea0dcfb6-e978-4254-92aa-befc3b87de8c req-720e2c00-d9e2-45d2-b1d1-efe555515cdf service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:23 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-ea0dcfb6-e978-4254-92aa-befc3b87de8c req-720e2c00-d9e2-45d2-b1d1-efe555515cdf service nova] Creating event network-vif-unplugged:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:47:23 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-ea0dcfb6-e978-4254-92aa-befc3b87de8c req-720e2c00-d9e2-45d2-b1d1-efe555515cdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028759 Apr 20 18:47:23 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 54/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] validate_networks() for [('dfac52da-60b6-4928-a243-f139eab2b8da', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:47:24 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:24 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-046b6790-9c89-43fc-a1f8-38abfc1694d0 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.203978 Apr 20 18:47:24 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 55/164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:23 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for user 2c6275ba3d2249c7a04952e5726bb633 and project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:47:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:47:24 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-022289e7-9a2d-4a7a-9a6a-0a77d1b87cad tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.936034 Apr 20 18:47:24 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 56/165] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:47:23 2023] POST /compute/v2.1/servers => generated 400 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:47:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-bb590091-8e48-44c8-8eb8-14c4fbb9e254 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:24 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-bb590091-8e48-44c8-8eb8-14c4fbb9e254 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:24 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-bb590091-8e48-44c8-8eb8-14c4fbb9e254 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-bb590091-8e48-44c8-8eb8-14c4fbb9e254 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 200 len: 1236 microversion: 2.1 time: 0.134894 Apr 20 18:47:24 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 55/166] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:24 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 1236 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:25 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-a2b90792-995b-496a-b886-90ed5ab23461 req-c6e6164e-e58e-4737-96be-d8cd8235ce31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "723ae2f4-e57d-4a56-8121-d27dc0e79869", "tag": "c5f4f824-9830-4d98-a4d0-27a42d4bce0b"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a2b90792-995b-496a-b886-90ed5ab23461 req-c6e6164e-e58e-4737-96be-d8cd8235ce31 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a2b90792-995b-496a-b886-90ed5ab23461 req-c6e6164e-e58e-4737-96be-d8cd8235ce31 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:25 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a2b90792-995b-496a-b886-90ed5ab23461 req-c6e6164e-e58e-4737-96be-d8cd8235ce31 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-a2b90792-995b-496a-b886-90ed5ab23461 req-c6e6164e-e58e-4737-96be-d8cd8235ce31 service nova] Creating event network-changed:c5f4f824-9830-4d98-a4d0-27a42d4bce0b for instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 on user Apr 20 18:47:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-a2b90792-995b-496a-b886-90ed5ab23461 req-c6e6164e-e58e-4737-96be-d8cd8235ce31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036438 Apr 20 18:47:25 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 56/167] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "name": "network-vif-plugged", "status": "completed", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}, {"server_uuid": "fca2bb9f-f489-4343-8d66-038fd5681bb9", "name": "network-vif-deleted", "tag": "b96f9721-790c-4f77-a7e4-de2f983a70b5"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] Creating event network-vif-plugged:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:47:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] Creating event network-vif-deleted:b96f9721-790c-4f77-a7e4-de2f983a70b5 for instance fca2bb9f-f489-4343-8d66-038fd5681bb9 on user Apr 20 18:47:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-a3ccf5f2-4c22-4c49-8d6f-7278f65df7fa req-f3ed8ae1-f815-4a5d-a861-c0c28133b491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034025 Apr 20 18:47:26 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:27 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-e917125c-074b-48bd-8bec-a3457ba71f29 req-8d947204-95ba-414c-8fb6-7e969e013c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723ae2f4-e57d-4a56-8121-d27dc0e79869", "name": "network-vif-plugged", "status": "completed", "tag": "c5f4f824-9830-4d98-a4d0-27a42d4bce0b"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-e917125c-074b-48bd-8bec-a3457ba71f29 req-8d947204-95ba-414c-8fb6-7e969e013c64 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-e917125c-074b-48bd-8bec-a3457ba71f29 req-8d947204-95ba-414c-8fb6-7e969e013c64 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:27 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-e917125c-074b-48bd-8bec-a3457ba71f29 req-8d947204-95ba-414c-8fb6-7e969e013c64 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:27 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-e917125c-074b-48bd-8bec-a3457ba71f29 req-8d947204-95ba-414c-8fb6-7e969e013c64 service nova] Creating event network-vif-plugged:c5f4f824-9830-4d98-a4d0-27a42d4bce0b for instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 on user Apr 20 18:47:27 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-e917125c-074b-48bd-8bec-a3457ba71f29 req-8d947204-95ba-414c-8fb6-7e969e013c64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033594 Apr 20 18:47:27 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 56/169] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:28 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-1e77be7b-402f-4726-88e4-9530b1949f28 req-11c4f86a-f909-473f-ba52-8ec7032a4f8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-1e77be7b-402f-4726-88e4-9530b1949f28 req-11c4f86a-f909-473f-ba52-8ec7032a4f8e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-1e77be7b-402f-4726-88e4-9530b1949f28 req-11c4f86a-f909-473f-ba52-8ec7032a4f8e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-1e77be7b-402f-4726-88e4-9530b1949f28 req-11c4f86a-f909-473f-ba52-8ec7032a4f8e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:28 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-1e77be7b-402f-4726-88e4-9530b1949f28 req-11c4f86a-f909-473f-ba52-8ec7032a4f8e service nova] Creating event network-changed:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:47:28 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-1e77be7b-402f-4726-88e4-9530b1949f28 req-11c4f86a-f909-473f-ba52-8ec7032a4f8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035478 Apr 20 18:47:28 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 57/170] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:29 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-e81316ad-e04e-4cd9-ab37-502e68427b90 req-8d837932-337a-40f7-a94e-6e9824b2804b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723ae2f4-e57d-4a56-8121-d27dc0e79869", "name": "network-vif-plugged", "status": "completed", "tag": "c5f4f824-9830-4d98-a4d0-27a42d4bce0b"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e81316ad-e04e-4cd9-ab37-502e68427b90 req-8d837932-337a-40f7-a94e-6e9824b2804b service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e81316ad-e04e-4cd9-ab37-502e68427b90 req-8d837932-337a-40f7-a94e-6e9824b2804b service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e81316ad-e04e-4cd9-ab37-502e68427b90 req-8d837932-337a-40f7-a94e-6e9824b2804b service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:29 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-e81316ad-e04e-4cd9-ab37-502e68427b90 req-8d837932-337a-40f7-a94e-6e9824b2804b service nova] Creating event network-vif-plugged:c5f4f824-9830-4d98-a4d0-27a42d4bce0b for instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 on user Apr 20 18:47:29 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-e81316ad-e04e-4cd9-ab37-502e68427b90 req-8d837932-337a-40f7-a94e-6e9824b2804b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032023 Apr 20 18:47:29 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 58/171] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:31 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}, {"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:31 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:31 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] Creating event network-vif-plugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:47:31 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] Creating event network-vif-plugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:47:31 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-85e175df-23bd-41fc-bf0e-bc87dcc91fc4 req-c2a100bf-026b-4481-882b-92ad799790e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035532 Apr 20 18:47:31 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 57/172] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:47:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=28 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:41 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f53ac3fb884290a0b57e68059bf789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e196bf571ed846339e119c1abdc7367e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:41 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-df1c4af6-9b13-41e7-be25-1fbac50e376b tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c" status: 200 len: 1494 microversion: 2.1 time: 0.247094 Apr 20 18:47:41 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:41 2023] GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c => generated 1494 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1374536707"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=12 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:44 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-73742754-aef7-4d83-90dc-da926af6531f tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1/action" status: 202 len: 52 microversion: 2.87 time: 0.915616 Apr 20 18:47:44 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 59/174] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 18:47:43 2023] POST /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1/action => generated 52 bytes in 918 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=4 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=17 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:49 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:50 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:50 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:50 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:47:50 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-95f7503c-a894-492a-a184-5dc313943595 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1" status: 200 len: 1690 microversion: 2.87 time: 0.295942 Apr 20 18:47:50 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 58/175] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:47:49 2023] GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 => generated 1690 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] HTTP exception thrown: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Request method failure captured: Apr 20 18:47:57 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 HTTP/1.1 Apr 20 18:47:57 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:47:57 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:47:57 user devstack@n-api.service[61668]: Connection: close Apr 20 18:47:57 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:47:57 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:47:57 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:47:57 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:47:57 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgTKJIwqPjfhyvQ3Ej0VEp9sSrOsUEJqoIeOm15ZFxQ67x4fZlq6QdoTJ4F4YKzhall1IXwz13jmF_7Js0gqwWHfwKRmSc0huu2tD_jXGChxnnfY8SdTWbk-SMZ3R_ytRsxojUmG_43-SW8mOQbaMa1u7AgH7QzrpnS1GDUbHgrsgo Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Project-Id: 75e72523e52246dbb13a936cafe97495 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/75e72523e52246dbb13a936cafe97495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75e72523e52246dbb13a936cafe97495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75e72523e52246dbb13a936cafe97495"}]}] Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Tenant-Id: 75e72523e52246dbb13a936cafe97495 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-User: tempest-AttachSCSIVolumeTestJSON-1911044708-project-member Apr 20 18:47:57 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:47:57 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:47:57 user devstack@n-api.service[61668]: X-User-Id: 58844c7c61ed40fd8251adfba29e5c24 Apr 20 18:47:57 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1911044708-project-member Apr 20 18:47:57 user devstack@n-api.service[61668]: method: > Apr 20 18:47:57 user devstack@n-api.service[61668]: exception: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:57 user devstack@n-api.service[61668]: action_args: {'id': '5ccb481e-a0af-4275-81a0-0ca282ae5737'} Apr 20 18:47:57 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Returning 404 to user: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:47:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-25f1c401-3e78-4f0d-a200-e3af902ea48c tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 404 len: 111 microversion: 2.1 time: 0.039422 Apr 20 18:47:57 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 59/176] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:57 2023] GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:47:57 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:57 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:47:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-afd91c40-86be-4d52-8bf9-03e8ca0caeb4 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '.version_select at 0x7fe63eb91360>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:57 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-afd91c40-86be-4d52-8bf9-03e8ca0caeb4 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-725283097" status: 202 len: 0 microversion: 2.1 time: 0.035873 Apr 20 18:47:57 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 60/177] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:47:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-725283097 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:58 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] HTTP exception thrown: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Request method failure captured: Apr 20 18:47:58 user devstack@n-api.service[61666]: request: DELETE /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 HTTP/1.1 Apr 20 18:47:58 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:47:58 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:47:58 user devstack@n-api.service[61666]: Connection: close Apr 20 18:47:58 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:47:58 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:47:58 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:47:58 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:47:58 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYgTKJIwqPjfhyvQ3Ej0VEp9sSrOsUEJqoIeOm15ZFxQ67x4fZlq6QdoTJ4F4YKzhall1IXwz13jmF_7Js0gqwWHfwKRmSc0huu2tD_jXGChxnnfY8SdTWbk-SMZ3R_ytRsxojUmG_43-SW8mOQbaMa1u7AgH7QzrpnS1GDUbHgrsgo Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Project-Id: 75e72523e52246dbb13a936cafe97495 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/75e72523e52246dbb13a936cafe97495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75e72523e52246dbb13a936cafe97495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75e72523e52246dbb13a936cafe97495"}]}] Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Tenant-Id: 75e72523e52246dbb13a936cafe97495 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-User: tempest-AttachSCSIVolumeTestJSON-1911044708-project-member Apr 20 18:47:58 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:47:58 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:47:58 user devstack@n-api.service[61666]: X-User-Id: 58844c7c61ed40fd8251adfba29e5c24 Apr 20 18:47:58 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1911044708-project-member Apr 20 18:47:58 user devstack@n-api.service[61666]: method: > Apr 20 18:47:58 user devstack@n-api.service[61666]: exception: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61666]: action_args: {'id': '5ccb481e-a0af-4275-81a0-0ca282ae5737'} Apr 20 18:47:58 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Returning 404 to user: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:47:58 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8023ee5b-0473-4067-8a07-00f7011ae1c5 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 404 len: 111 microversion: 2.1 time: 0.034375 Apr 20 18:47:58 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 59/178] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:47:58 2023] DELETE /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] [instance: 5ccb481e-a0af-4275-81a0-0ca282ae5737] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:47:58 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] HTTP exception thrown: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Request method failure captured: Apr 20 18:47:58 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 HTTP/1.1 Apr 20 18:47:58 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:47:58 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:47:58 user devstack@n-api.service[61668]: Connection: close Apr 20 18:47:58 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:47:58 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:47:58 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:47:58 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:47:58 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgTKJIwqPjfhyvQ3Ej0VEp9sSrOsUEJqoIeOm15ZFxQ67x4fZlq6QdoTJ4F4YKzhall1IXwz13jmF_7Js0gqwWHfwKRmSc0huu2tD_jXGChxnnfY8SdTWbk-SMZ3R_ytRsxojUmG_43-SW8mOQbaMa1u7AgH7QzrpnS1GDUbHgrsgo Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Project-Id: 75e72523e52246dbb13a936cafe97495 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/75e72523e52246dbb13a936cafe97495"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75e72523e52246dbb13a936cafe97495"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/75e72523e52246dbb13a936cafe97495"}]}] Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Tenant-Id: 75e72523e52246dbb13a936cafe97495 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1911044708 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-User: tempest-AttachSCSIVolumeTestJSON-1911044708-project-member Apr 20 18:47:58 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:47:58 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:47:58 user devstack@n-api.service[61668]: X-User-Id: 58844c7c61ed40fd8251adfba29e5c24 Apr 20 18:47:58 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1911044708-project-member Apr 20 18:47:58 user devstack@n-api.service[61668]: method: > Apr 20 18:47:58 user devstack@n-api.service[61668]: exception: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61668]: action_args: {'id': '5ccb481e-a0af-4275-81a0-0ca282ae5737'} Apr 20 18:47:58 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. Apr 20 18:47:58 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:47:58 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] Returning 404 to user: Instance 5ccb481e-a0af-4275-81a0-0ca282ae5737 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:47:58 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-8522e5a4-b43a-43fb-a0a4-cbd4d3aa3930 tempest-AttachSCSIVolumeTestJSON-1911044708 tempest-AttachSCSIVolumeTestJSON-1911044708-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737" status: 404 len: 111 microversion: 2.1 time: 0.030447 Apr 20 18:47:58 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 60/179] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:47:58 2023] GET /compute/v2.1/servers/5ccb481e-a0af-4275-81a0-0ca282ae5737 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:12 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:12 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-bfd85a9c-ca96-4de1-8689-2ab8b4ba2535 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 200 len: 1493 microversion: 2.1 time: 0.221009 Apr 20 18:48:12 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 61/180] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:12 2023] GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 1493 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=8 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:13 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] HTTP exception thrown: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Request method failure captured: Apr 20 18:48:13 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 HTTP/1.1 Apr 20 18:48:13 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:48:13 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:48:13 user devstack@n-api.service[61666]: Connection: close Apr 20 18:48:13 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:48:13 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:48:13 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:48:13 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:48:13 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhFeVBrtv8-q_wcBlELmBaDNy-dhMo_dIwFyuiiKuGXTEDWm3WoDtMp2XbwITyBe7fq1lEV9xLWLCJ-fNdnH_NV_52wQTcnPppJZme3UfIaDBaFT91xgT3tNzSRV4ZzcoUf0HiMhw7OqgrVEL8CKag9CQaCaZYEZ69bIGCGpwZ3UkE Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Project-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}] Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Tenant-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:48:13 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:48:13 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:48:13 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:48:13 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:48:13 user devstack@n-api.service[61666]: X-User-Id: 10dd79d3683e4780b76f0f2d9b6aefae Apr 20 18:48:13 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:48:13 user devstack@n-api.service[61666]: method: > Apr 20 18:48:13 user devstack@n-api.service[61666]: exception: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:48:13 user devstack@n-api.service[61666]: action_args: {'id': 'fca2bb9f-f489-4343-8d66-038fd5681bb9'} Apr 20 18:48:13 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:48:13 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:48:13 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Returning 404 to user: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:48:13 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8b54de54-902f-4c1b-ac4b-4d36573ebc2e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 404 len: 111 microversion: 2.1 time: 0.030816 Apr 20 18:48:13 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 60/181] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:13 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:48:13 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-89cc87ea-d028-44e2-9b4d-8c5bfe4007ce tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '.version_select at 0x7fe63f9d7e20>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:13 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:13 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:13 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-89cc87ea-d028-44e2-9b4d-8c5bfe4007ce tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098022951" status: 202 len: 0 microversion: 2.1 time: 0.028721 Apr 20 18:48:13 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 61/182] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 18:48:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1098022951 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:48:14 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-24be06df-f078-4e78-8981-3fa4df9261ab tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Action: 'create', calling method: .version_select at 0x7fe63edcbd00>, body: {"keypair": {"name": "tempest-keypair-438564443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyw9fdDPrxVco7aDU5zyetKPYO3TQPOyemwx4MIdQUIqwzJpYonwVosW7Aldt+s7oiZ60u9I9kiBCHumjYN5BtGL68O2ecWpV0TCTbqGhSQIjoWKMC2WAuzKKJuWWtQRA=="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:14 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-24be06df-f078-4e78-8981-3fa4df9261ab tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:48:14 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-24be06df-f078-4e78-8981-3fa4df9261ab tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for user 10dd79d3683e4780b76f0f2d9b6aefae and project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:48:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-24be06df-f078-4e78-8981-3fa4df9261ab tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047522 Apr 20 18:48:14 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 62/183] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:48:14 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:15 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:15 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-effeeb0c-9d06-45d5-8c49-1ffa830047af tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 200 len: 1546 microversion: 2.1 time: 0.229479 Apr 20 18:48:15 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:15 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 1546 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1293954382", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8db78bf5-b844-4675-800a-28a20b815045"}], "security_groups": [{"name": "tempest-securitygroup--863194802"}], "key_name": "tempest-keypair-438564443", "user_data": "}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] validate_networks() for [('8db78bf5-b844-4675-800a-28a20b815045', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:16 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:16 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-6b43a66b-aa31-468e-a258-24103008d95a tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9" status: 200 len: 1503 microversion: 2.1 time: 0.233353 Apr 20 18:48:16 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:16 2023] GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Getting quotas for user 10dd79d3683e4780b76f0f2d9b6aefae and project 9eebb7c6a8414543b3d9c5830fddb2c2. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:48:16 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:48:16 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-6f4ba557-adfc-4233-8aef-21198181b582 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.601564 Apr 20 18:48:16 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 62/186] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:48:15 2023] POST /compute/v2.1/servers => generated 399 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:48:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-00266784-eabb-48bf-adc5-3ed4455a390e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:16 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-00266784-eabb-48bf-adc5-3ed4455a390e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:16 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-00266784-eabb-48bf-adc5-3ed4455a390e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd79d3683e4780b76f0f2d9b6aefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eebb7c6a8414543b3d9c5830fddb2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:16 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-00266784-eabb-48bf-adc5-3ed4455a390e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 200 len: 1231 microversion: 2.1 time: 0.056980 Apr 20 18:48:16 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 62/187] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:16 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 1231 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:19 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60a516ce54dca948df4efb3d5aa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a090198081045f0a7ad32c8c9898ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:19 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-57c9574b-71a7-4d23-9b04-26755e3a3963 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 200 len: 1668 microversion: 2.1 time: 0.225803 Apr 20 18:48:19 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 64/188] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:19 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 1668 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:19 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-4bf1a4ee-b2dc-40ce-841a-fcf25e1dd3b7 req-53f1919c-bb56-4be9-9a18-0e36571bd01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4bf1a4ee-b2dc-40ce-841a-fcf25e1dd3b7 req-53f1919c-bb56-4be9-9a18-0e36571bd01e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4bf1a4ee-b2dc-40ce-841a-fcf25e1dd3b7 req-53f1919c-bb56-4be9-9a18-0e36571bd01e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4bf1a4ee-b2dc-40ce-841a-fcf25e1dd3b7 req-53f1919c-bb56-4be9-9a18-0e36571bd01e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-4bf1a4ee-b2dc-40ce-841a-fcf25e1dd3b7 req-53f1919c-bb56-4be9-9a18-0e36571bd01e service nova] Creating event network-changed:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:48:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-4bf1a4ee-b2dc-40ce-841a-fcf25e1dd3b7 req-53f1919c-bb56-4be9-9a18-0e36571bd01e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033695 Apr 20 18:48:19 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 63/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:20 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8b0961fd-bf3c-4fba-8a3e-ed083a65453c tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '.version_select at 0x7fe63ebf7eb0>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8b0961fd-bf3c-4fba-8a3e-ed083a65453c tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f" status: 204 len: 0 microversion: 2.1 time: 0.221420 Apr 20 18:48:21 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 63/190] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:20 2023] DELETE /compute/v2.1/images/2f01ae5c-a962-423b-94ae-ce0c994a722f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:48:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-1ae334c2-cf6d-48be-81a6-fab306ccf7f6 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 204 len: 0 microversion: 2.1 time: 0.111539 Apr 20 18:48:21 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:48:21 2023] DELETE /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:21 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60a516ce54dca948df4efb3d5aa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a090198081045f0a7ad32c8c9898ed6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:21 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-f462b92f-d5de-4ece-b05e-5071c604f75d tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 200 len: 1674 microversion: 2.1 time: 0.310623 Apr 20 18:48:21 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:21 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 1674 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:21 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-e6e5a427-2e7a-4150-a6cc-6a2f2c538ce6 req-f3393367-f90a-4d4f-b916-80a6616308c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "name": "network-vif-plugged", "status": "completed", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-8f7952ba-c6bc-43e1-a2b2-7ee561631d6f req-fc30c716-2218-4253-adf0-883896843aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "name": "network-vif-unplugged", "status": "completed", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:21 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-e6e5a427-2e7a-4150-a6cc-6a2f2c538ce6 req-f3393367-f90a-4d4f-b916-80a6616308c2 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:21 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-e6e5a427-2e7a-4150-a6cc-6a2f2c538ce6 req-f3393367-f90a-4d4f-b916-80a6616308c2 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:21 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-e6e5a427-2e7a-4150-a6cc-6a2f2c538ce6 req-f3393367-f90a-4d4f-b916-80a6616308c2 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-8f7952ba-c6bc-43e1-a2b2-7ee561631d6f req-fc30c716-2218-4253-adf0-883896843aa5 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-8f7952ba-c6bc-43e1-a2b2-7ee561631d6f req-fc30c716-2218-4253-adf0-883896843aa5 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-8f7952ba-c6bc-43e1-a2b2-7ee561631d6f req-fc30c716-2218-4253-adf0-883896843aa5 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-e6e5a427-2e7a-4150-a6cc-6a2f2c538ce6 req-f3393367-f90a-4d4f-b916-80a6616308c2 service nova] Creating event network-vif-plugged:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:48:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-8f7952ba-c6bc-43e1-a2b2-7ee561631d6f req-fc30c716-2218-4253-adf0-883896843aa5 service nova] Creating event network-vif-unplugged:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:48:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-e6e5a427-2e7a-4150-a6cc-6a2f2c538ce6 req-f3393367-f90a-4d4f-b916-80a6616308c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072225 Apr 20 18:48:21 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 64/193] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-8f7952ba-c6bc-43e1-a2b2-7ee561631d6f req-fc30c716-2218-4253-adf0-883896843aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040881 Apr 20 18:48:21 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 66/194] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:23 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-57e94697-b9eb-4e7f-82ef-15cec69a0800 req-93668b56-6f83-4a94-bb46-16071569897e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "name": "network-vif-plugged", "status": "completed", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:23 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "name": "network-vif-plugged", "status": "completed", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}, {"server_uuid": "2c9dcf1d-faea-40aa-80fd-53ef56c778e2", "name": "network-vif-deleted", "tag": "76f230c3-d4c4-4fd3-8032-355e44bf0e33"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-57e94697-b9eb-4e7f-82ef-15cec69a0800 req-93668b56-6f83-4a94-bb46-16071569897e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-57e94697-b9eb-4e7f-82ef-15cec69a0800 req-93668b56-6f83-4a94-bb46-16071569897e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:23 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-57e94697-b9eb-4e7f-82ef-15cec69a0800 req-93668b56-6f83-4a94-bb46-16071569897e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:23 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:23 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-57e94697-b9eb-4e7f-82ef-15cec69a0800 req-93668b56-6f83-4a94-bb46-16071569897e service nova] Creating event network-vif-plugged:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:48:23 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-57e94697-b9eb-4e7f-82ef-15cec69a0800 req-93668b56-6f83-4a94-bb46-16071569897e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032195 Apr 20 18:48:23 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] Creating event network-vif-plugged:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:48:23 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] Creating event network-vif-deleted:76f230c3-d4c4-4fd3-8032-355e44bf0e33 for instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 on user Apr 20 18:48:23 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 65/195] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:23 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-73a8fea1-b9d1-4893-a7bb-b55041b5b9ec req-e5d4cc07-111c-471d-9100-273b0d15fb5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028790 Apr 20 18:48:23 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 65/196] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:23 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:25 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:25 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-cb65a807-0a27-4414-901e-0455fa615615 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.236872 Apr 20 18:48:25 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 67/197] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:25 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=12 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-e4f165a7-9bdf-4520-9ac6-a6ae4a8cd49c tempest-TestShelveInstance-1912059179 tempest-TestShelveInstance-1912059179-project-member] Action: 'create', calling method: .version_select at 0x7fe63f6a2b90>, body: {"keypair": {"name": "tempest-TestShelveInstance-785527193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLx7gIk5hJTF4QOEO2Ok95DE5sJ9E9kqO9foD9wXXVRCU1xBhr8jPtgkzdnxsrpTCQoxLgcwpj2Z0vjz3iEsQI1qC9Te/aaO7InLYvhjWZhd2mv095xkJXzsJhYdTC840A=="}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-e4f165a7-9bdf-4520-9ac6-a6ae4a8cd49c tempest-TestShelveInstance-1912059179 tempest-TestShelveInstance-1912059179-project-member] Getting quotas for project c44e57366dd74d18bd170de52e42afa7. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:48:35 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-e4f165a7-9bdf-4520-9ac6-a6ae4a8cd49c tempest-TestShelveInstance-1912059179 tempest-TestShelveInstance-1912059179-project-member] Getting quotas for user 6ecb18aba3804b45af22c6e37146898d and project c44e57366dd74d18bd170de52e42afa7. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:48:35 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-e4f165a7-9bdf-4520-9ac6-a6ae4a8cd49c tempest-TestShelveInstance-1912059179 tempest-TestShelveInstance-1912059179-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.275142 Apr 20 18:48:35 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 66/198] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:48:35 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:38 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:38 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=12 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:38 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=12 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:38 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-d3d860d2-5bb4-4cf6-9674-280547438c40 tempest-TestShelveInstance-1912059179 tempest-TestShelveInstance-1912059179-project-member] Calling method '.version_select at 0x7fe63ebf7be0>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:38 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-d3d860d2-5bb4-4cf6-9674-280547438c40 tempest-TestShelveInstance-1912059179 tempest-TestShelveInstance-1912059179-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-785527193" status: 202 len: 0 microversion: 2.1 time: 0.036541 Apr 20 18:48:38 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 66/199] 10.0.0.210 () {62 vars in 1328 bytes} [Thu Apr 20 18:48:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-785527193 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:42 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:43 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:48:43 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a545240d-9389-42ad-9310-2155274f1575 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c" status: 204 len: 0 microversion: 2.1 time: 0.227052 Apr 20 18:48:43 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 68/200] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:48:42 2023] DELETE /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:43 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-18a597f7-2f80-4c0c-b048-454676848952 req-012a5eb4-f6c0-432f-b7ce-efb06e04828c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a235505e-9475-4676-80db-0aef8e52a34c", "name": "network-vif-unplugged", "status": "completed", "tag": "8a394d73-7929-4f4e-908b-a779e6683c59"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:43 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-18a597f7-2f80-4c0c-b048-454676848952 req-012a5eb4-f6c0-432f-b7ce-efb06e04828c service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:43 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-18a597f7-2f80-4c0c-b048-454676848952 req-012a5eb4-f6c0-432f-b7ce-efb06e04828c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:43 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-18a597f7-2f80-4c0c-b048-454676848952 req-012a5eb4-f6c0-432f-b7ce-efb06e04828c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:43 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-18a597f7-2f80-4c0c-b048-454676848952 req-012a5eb4-f6c0-432f-b7ce-efb06e04828c service nova] Creating event network-vif-unplugged:8a394d73-7929-4f4e-908b-a779e6683c59 for instance a235505e-9475-4676-80db-0aef8e52a34c on user Apr 20 18:48:43 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-18a597f7-2f80-4c0c-b048-454676848952 req-012a5eb4-f6c0-432f-b7ce-efb06e04828c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032704 Apr 20 18:48:43 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 67/201] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:43 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f53ac3fb884290a0b57e68059bf789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e196bf571ed846339e119c1abdc7367e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:43 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-28e5124b-1f1e-4c05-b642-3a8577d7ad5d tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c" status: 200 len: 1500 microversion: 2.1 time: 0.394994 Apr 20 18:48:43 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 67/202] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:48:43 2023] GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c => generated 1500 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:48:44 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-64ed4825-5667-4790-a722-413dbef6b262 req-2c9cbd79-a617-4d77-8657-bf155c2ad5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a235505e-9475-4676-80db-0aef8e52a34c", "name": "network-vif-deleted", "tag": "8a394d73-7929-4f4e-908b-a779e6683c59"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:44 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-64ed4825-5667-4790-a722-413dbef6b262 req-2c9cbd79-a617-4d77-8657-bf155c2ad5f6 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:44 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-64ed4825-5667-4790-a722-413dbef6b262 req-2c9cbd79-a617-4d77-8657-bf155c2ad5f6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:44 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-64ed4825-5667-4790-a722-413dbef6b262 req-2c9cbd79-a617-4d77-8657-bf155c2ad5f6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:44 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-64ed4825-5667-4790-a722-413dbef6b262 req-2c9cbd79-a617-4d77-8657-bf155c2ad5f6 service nova] Creating event network-vif-deleted:8a394d73-7929-4f4e-908b-a779e6683c59 for instance a235505e-9475-4676-80db-0aef8e52a34c on user Apr 20 18:48:44 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-64ed4825-5667-4790-a722-413dbef6b262 req-2c9cbd79-a617-4d77-8657-bf155c2ad5f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052292 Apr 20 18:48:44 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 69/203] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:45 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-4454063e-7354-41a5-b902-4a5ececeae8c req-2df7111f-0640-4757-84d2-4f3767158adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a235505e-9475-4676-80db-0aef8e52a34c", "name": "network-vif-plugged", "status": "completed", "tag": "8a394d73-7929-4f4e-908b-a779e6683c59"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4454063e-7354-41a5-b902-4a5ececeae8c req-2df7111f-0640-4757-84d2-4f3767158adc service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4454063e-7354-41a5-b902-4a5ececeae8c req-2df7111f-0640-4757-84d2-4f3767158adc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:45 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4454063e-7354-41a5-b902-4a5ececeae8c req-2df7111f-0640-4757-84d2-4f3767158adc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:45 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-4454063e-7354-41a5-b902-4a5ececeae8c req-2df7111f-0640-4757-84d2-4f3767158adc service nova] Creating event network-vif-plugged:8a394d73-7929-4f4e-908b-a779e6683c59 for instance a235505e-9475-4676-80db-0aef8e52a34c on user Apr 20 18:48:45 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-4454063e-7354-41a5-b902-4a5ececeae8c req-2df7111f-0640-4757-84d2-4f3767158adc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029657 Apr 20 18:48:45 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 68/204] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-52172754", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "507056ae-4667-4837-80d1-49f642249cfa"}]}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] validate_networks() for [('507056ae-4667-4837-80d1-49f642249cfa', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for user 1332e51aa657411cb00f200b592c39f1 and project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:48:50 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:48:50 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-1f658c74-b4c1-4d54-aebc-5d5c899abc00 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.536111 Apr 20 18:48:51 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 68/205] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 18:48:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 18:48:51 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-655e0803-d252-42bb-ab68-1002c82bf4c2 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:48:51 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-655e0803-d252-42bb-ab68-1002c82bf4c2 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:48:51 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-655e0803-d252-42bb-ab68-1002c82bf4c2 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:51 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-655e0803-d252-42bb-ab68-1002c82bf4c2 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:51 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-655e0803-d252-42bb-ab68-1002c82bf4c2 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:48:51 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-655e0803-d252-42bb-ab68-1002c82bf4c2 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2" status: 200 len: 1393 microversion: 2.87 time: 0.092020 Apr 20 18:48:51 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 70/206] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:48:51 2023] GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2 => generated 1393 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:48:53 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-64c2c23a-81dc-47fd-849c-7a734548ecac req-c7d0b4dc-f19e-4c39-9e87-f7ba030f0ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68899b59-93c7-429f-9bc2-0eea1b3099b2", "tag": "30726175-1750-4814-aed9-f5326021f325"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:53 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-64c2c23a-81dc-47fd-849c-7a734548ecac req-c7d0b4dc-f19e-4c39-9e87-f7ba030f0ab3 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:53 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-64c2c23a-81dc-47fd-849c-7a734548ecac req-c7d0b4dc-f19e-4c39-9e87-f7ba030f0ab3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:53 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-64c2c23a-81dc-47fd-849c-7a734548ecac req-c7d0b4dc-f19e-4c39-9e87-f7ba030f0ab3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:53 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-64c2c23a-81dc-47fd-849c-7a734548ecac req-c7d0b4dc-f19e-4c39-9e87-f7ba030f0ab3 service nova] Creating event network-changed:30726175-1750-4814-aed9-f5326021f325 for instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 on user Apr 20 18:48:53 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-64c2c23a-81dc-47fd-849c-7a734548ecac req-c7d0b4dc-f19e-4c39-9e87-f7ba030f0ab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028499 Apr 20 18:48:53 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 69/207] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:48:55 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-edf070fe-172a-4f18-8cec-b0a03c87e119 req-a888ace0-b753-4755-ac32-aa5e29909489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68899b59-93c7-429f-9bc2-0eea1b3099b2", "name": "network-vif-deleted", "tag": "30726175-1750-4814-aed9-f5326021f325"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:48:55 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-edf070fe-172a-4f18-8cec-b0a03c87e119 req-a888ace0-b753-4755-ac32-aa5e29909489 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:48:55 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-edf070fe-172a-4f18-8cec-b0a03c87e119 req-a888ace0-b753-4755-ac32-aa5e29909489 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:48:55 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-edf070fe-172a-4f18-8cec-b0a03c87e119 req-a888ace0-b753-4755-ac32-aa5e29909489 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:48:55 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.compute.server_external_events [req-edf070fe-172a-4f18-8cec-b0a03c87e119 req-a888ace0-b753-4755-ac32-aa5e29909489 service nova] Unable to find a host for instance 68899b59-93c7-429f-9bc2-0eea1b3099b2. Dropping event network-vif-deleted {{(pid=61668) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 18:48:55 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-edf070fe-172a-4f18-8cec-b0a03c87e119 req-a888ace0-b753-4755-ac32-aa5e29909489 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.024947 Apr 20 18:48:55 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:48:55 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:06 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd79d3683e4780b76f0f2d9b6aefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eebb7c6a8414543b3d9c5830fddb2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:06 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-096c1503-e857-4d5e-8f53-15d0bd5927ea tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 200 len: 1537 microversion: 2.1 time: 0.237573 Apr 20 18:49:06 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 71/209] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:06 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 1537 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] [instance: 2c9dcf1d-faea-40aa-80fd-53ef56c778e2] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:11 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] HTTP exception thrown: Instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 could not be found. Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Request method failure captured: Apr 20 18:49:11 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 HTTP/1.1 Apr 20 18:49:11 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:49:11 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:49:11 user devstack@n-api.service[61666]: Connection: close Apr 20 18:49:11 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:49:11 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:49:11 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:49:11 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:49:11 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYgJ_77KaLQs_4-Brt0c_DWuJWvIXKSvgMTLr51RpeGX0iOXd88Wa50YbbBT3jsvMr81KjU_NJ9l8px7G_-lFdRHyNXcOgSKwYgYebsVBIZfPgD6x1O6Za0qzfDSwPgaX3r6NbhxOc_n9K9kGyskdZHcqxoaplyHzSvyddDFd_PvgpU Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Project-Id: 0a090198081045f0a7ad32c8c9898ed6 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1113026279 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a090198081045f0a7ad32c8c9898ed6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a090198081045f0a7ad32c8c9898ed6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a090198081045f0a7ad32c8c9898ed6"}]}] Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Tenant: tempest-ServerStableDeviceRescueTest-1113026279 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Tenant-Id: 0a090198081045f0a7ad32c8c9898ed6 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1113026279 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-User: tempest-ServerStableDeviceRescueTest-1113026279-project-member Apr 20 18:49:11 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:49:11 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:49:11 user devstack@n-api.service[61666]: X-User-Id: beb60a516ce54dca948df4efb3d5aa68 Apr 20 18:49:11 user devstack@n-api.service[61666]: X-User-Name: tempest-ServerStableDeviceRescueTest-1113026279-project-member Apr 20 18:49:11 user devstack@n-api.service[61666]: method: > Apr 20 18:49:11 user devstack@n-api.service[61666]: exception: Instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 could not be found. Apr 20 18:49:11 user devstack@n-api.service[61666]: action_args: {'id': '2c9dcf1d-faea-40aa-80fd-53ef56c778e2'} Apr 20 18:49:11 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 could not be found. Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 could not be found. Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 could not be found. Apr 20 18:49:11 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:49:11 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Returning 404 to user: Instance 2c9dcf1d-faea-40aa-80fd-53ef56c778e2 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:49:11 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-852d5ab7-e126-463d-9707-f7a01d85b4a0 tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2" status: 404 len: 111 microversion: 2.1 time: 0.032229 Apr 20 18:49:11 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:11 2023] GET /compute/v2.1/servers/2c9dcf1d-faea-40aa-80fd-53ef56c778e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:49:11 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-e889c7e0-a4a0-4bcd-a351-43edf5f1ff9e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] Calling method '.version_select at 0x7fe6400309d0>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=10 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:11 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-e889c7e0-a4a0-4bcd-a351-43edf5f1ff9e tempest-ServerStableDeviceRescueTest-1113026279 tempest-ServerStableDeviceRescueTest-1113026279-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-451012052" status: 202 len: 0 microversion: 2.1 time: 0.030961 Apr 20 18:49:11 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:49:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-451012052 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:12 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:49:12 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8cab3b0a-31ff-49b8-92b8-e478cb2fa6ad tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 204 len: 0 microversion: 2.1 time: 0.114909 Apr 20 18:49:12 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 72/212] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:49:12 2023] DELETE /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:12 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-6cac41b1-d229-4f8a-8a3f-73d3ed612978 req-a53a3f40-48cc-4e33-a900-2215e8c9196c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723ae2f4-e57d-4a56-8121-d27dc0e79869", "name": "network-vif-unplugged", "status": "completed", "tag": "c5f4f824-9830-4d98-a4d0-27a42d4bce0b"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6cac41b1-d229-4f8a-8a3f-73d3ed612978 req-a53a3f40-48cc-4e33-a900-2215e8c9196c service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6cac41b1-d229-4f8a-8a3f-73d3ed612978 req-a53a3f40-48cc-4e33-a900-2215e8c9196c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6cac41b1-d229-4f8a-8a3f-73d3ed612978 req-a53a3f40-48cc-4e33-a900-2215e8c9196c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:12 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-6cac41b1-d229-4f8a-8a3f-73d3ed612978 req-a53a3f40-48cc-4e33-a900-2215e8c9196c service nova] Creating event network-vif-unplugged:c5f4f824-9830-4d98-a4d0-27a42d4bce0b for instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 on user Apr 20 18:49:12 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-6cac41b1-d229-4f8a-8a3f-73d3ed612978 req-a53a3f40-48cc-4e33-a900-2215e8c9196c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027736 Apr 20 18:49:12 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 71/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:13 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:13 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-4177a01d-685b-46b3-bfb9-5b801cad68c3 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 200 len: 1499 microversion: 2.1 time: 0.787463 Apr 20 18:49:13 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:12 2023] GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 1499 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:13 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-e6f24a37-fd27-45f1-9893-73cd40cd9484 req-4c31fa04-d6cf-4233-b68c-ab4ce46befd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723ae2f4-e57d-4a56-8121-d27dc0e79869", "name": "network-vif-deleted", "tag": "c5f4f824-9830-4d98-a4d0-27a42d4bce0b"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e6f24a37-fd27-45f1-9893-73cd40cd9484 req-4c31fa04-d6cf-4233-b68c-ab4ce46befd9 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e6f24a37-fd27-45f1-9893-73cd40cd9484 req-4c31fa04-d6cf-4233-b68c-ab4ce46befd9 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e6f24a37-fd27-45f1-9893-73cd40cd9484 req-4c31fa04-d6cf-4233-b68c-ab4ce46befd9 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-e6f24a37-fd27-45f1-9893-73cd40cd9484 req-4c31fa04-d6cf-4233-b68c-ab4ce46befd9 service nova] Creating event network-vif-deleted:c5f4f824-9830-4d98-a4d0-27a42d4bce0b for instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 on user Apr 20 18:49:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-e6f24a37-fd27-45f1-9893-73cd40cd9484 req-4c31fa04-d6cf-4233-b68c-ab4ce46befd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033082 Apr 20 18:49:14 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 73/215] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:14 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-a6e938c9-846d-4449-91b9-bed1136ac445 req-24072f4a-5141-4bb3-941c-45090a0847d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "723ae2f4-e57d-4a56-8121-d27dc0e79869", "name": "network-vif-plugged", "status": "completed", "tag": "c5f4f824-9830-4d98-a4d0-27a42d4bce0b"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a6e938c9-846d-4449-91b9-bed1136ac445 req-24072f4a-5141-4bb3-941c-45090a0847d3 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a6e938c9-846d-4449-91b9-bed1136ac445 req-24072f4a-5141-4bb3-941c-45090a0847d3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-a6e938c9-846d-4449-91b9-bed1136ac445 req-24072f4a-5141-4bb3-941c-45090a0847d3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:14 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-a6e938c9-846d-4449-91b9-bed1136ac445 req-24072f4a-5141-4bb3-941c-45090a0847d3 service nova] Creating event network-vif-plugged:c5f4f824-9830-4d98-a4d0-27a42d4bce0b for instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 on user Apr 20 18:49:14 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-a6e938c9-846d-4449-91b9-bed1136ac445 req-24072f4a-5141-4bb3-941c-45090a0847d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030663 Apr 20 18:49:14 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 72/216] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:15 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:15 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f8975c45-9f52-49a3-82e1-8dece72638c8 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.221872 Apr 20 18:49:15 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:49:15 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9/os-interface => generated 282 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:16 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a816df18-3c9d-4c85-9811-331a2cdf7014 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9/ips" status: 200 len: 108 microversion: 2.1 time: 0.039515 Apr 20 18:49:16 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 74/218] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:49:16 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9/ips => generated 108 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:16 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-13673865-d69e-4daa-a5b3-2a9892762998 req-4ee0886f-ba62-4f9e-bade-ab705d9e09b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-13673865-d69e-4daa-a5b3-2a9892762998 req-4ee0886f-ba62-4f9e-bade-ab705d9e09b6 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-13673865-d69e-4daa-a5b3-2a9892762998 req-4ee0886f-ba62-4f9e-bade-ab705d9e09b6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:16 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-13673865-d69e-4daa-a5b3-2a9892762998 req-4ee0886f-ba62-4f9e-bade-ab705d9e09b6 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:16 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-13673865-d69e-4daa-a5b3-2a9892762998 req-4ee0886f-ba62-4f9e-bade-ab705d9e09b6 service nova] Creating event network-changed:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:16 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-13673865-d69e-4daa-a5b3-2a9892762998 req-4ee0886f-ba62-4f9e-bade-ab705d9e09b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033779 Apr 20 18:49:16 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 73/219] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:17 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:49:17 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7bed9d0f-e776-43ba-b154-b9ba1ac89ae1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 204 len: 0 microversion: 2.1 time: 0.121825 Apr 20 18:49:17 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:49:17 2023] DELETE /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:17 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:18 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:18 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-7d30703b-6071-43cd-aedd-f52e6af1b54c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 200 len: 1671 microversion: 2.1 time: 0.331276 Apr 20 18:49:18 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 75/221] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:17 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 1671 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:18 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-unplugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}, {"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}, {"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:18 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:18 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:18 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:18 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Creating event network-vif-unplugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:18 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Creating event network-vif-plugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:18 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] Creating event network-vif-plugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:18 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-309a4e1b-9c5c-4808-b389-20e1cc35983e req-03079be3-81b8-4e3b-aecf-0ded0d238605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.030376 Apr 20 18:49:18 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 74/222] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:18 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:19 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-4a543b1d-7122-4c5b-9b74-3f6e92a6ed13 req-b42bb460-b923-4e5d-9eb3-6a487d673bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-deleted", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4a543b1d-7122-4c5b-9b74-3f6e92a6ed13 req-b42bb460-b923-4e5d-9eb3-6a487d673bc2 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4a543b1d-7122-4c5b-9b74-3f6e92a6ed13 req-b42bb460-b923-4e5d-9eb3-6a487d673bc2 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:19 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-4a543b1d-7122-4c5b-9b74-3f6e92a6ed13 req-b42bb460-b923-4e5d-9eb3-6a487d673bc2 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:19 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-4a543b1d-7122-4c5b-9b74-3f6e92a6ed13 req-b42bb460-b923-4e5d-9eb3-6a487d673bc2 service nova] Creating event network-vif-deleted:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:19 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-4a543b1d-7122-4c5b-9b74-3f6e92a6ed13 req-b42bb460-b923-4e5d-9eb3-6a487d673bc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033235 Apr 20 18:49:19 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 74/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:19 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:49:19 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-d126bacf-ddaa-47be-ab93-ffce001ea367 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 204 len: 0 microversion: 2.1 time: 0.130049 Apr 20 18:49:19 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 76/224] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:49:19 2023] DELETE /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:19 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-eca77c51-c471-4076-a2fd-3bdb6f1a9887 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 200 len: 1495 microversion: 2.1 time: 0.304056 Apr 20 18:49:19 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 75/225] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:19 2023] GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 1495 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:20 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}, {"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-unplugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}, {"server_uuid": "cd303dc8-9628-437c-a220-109b96c258e9", "name": "network-vif-plugged", "status": "completed", "tag": "3d77cd91-f840-4ee2-80ae-c58a25acaab9"}, {"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-unplugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}, {"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-plugged", "status": "completed", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:20 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:21 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:21 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Creating event network-vif-plugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Creating event network-vif-unplugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Creating event network-vif-plugged:3d77cd91-f840-4ee2-80ae-c58a25acaab9 for instance cd303dc8-9628-437c-a220-109b96c258e9 on user Apr 20 18:49:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Creating event network-vif-unplugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:49:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] Creating event network-vif-plugged:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:49:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-8c4fb512-a824-4fb8-80a8-02e130327881 req-028f2bdd-9621-4902-8b36-0e5abae82031 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.044291 Apr 20 18:49:21 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 75/226] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:20 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:21 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-afc84314-4ca0-4842-bfe7-794946d03343 req-f2c65369-01de-4386-8406-d6fa83d500f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0332417-891a-4c2a-bd86-b2fad86f7df9", "name": "network-vif-deleted", "tag": "710c585b-9a97-404e-a812-e53605dc6aff"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-afc84314-4ca0-4842-bfe7-794946d03343 req-f2c65369-01de-4386-8406-d6fa83d500f7 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-afc84314-4ca0-4842-bfe7-794946d03343 req-f2c65369-01de-4386-8406-d6fa83d500f7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:21 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-afc84314-4ca0-4842-bfe7-794946d03343 req-f2c65369-01de-4386-8406-d6fa83d500f7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-afc84314-4ca0-4842-bfe7-794946d03343 req-f2c65369-01de-4386-8406-d6fa83d500f7 service nova] Creating event network-vif-deleted:710c585b-9a97-404e-a812-e53605dc6aff for instance a0332417-891a-4c2a-bd86-b2fad86f7df9 on user Apr 20 18:49:21 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-afc84314-4ca0-4842-bfe7-794946d03343 req-f2c65369-01de-4386-8406-d6fa83d500f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030585 Apr 20 18:49:21 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 77/227] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:26 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:26 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-731f90f4-1480-4993-ade3-dd85ad2bdfd4 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.297640 Apr 20 18:49:26 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 76/228] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:26 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:26 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-d14f0740-a0df-4d41-b741-70ab808246f9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.190169 Apr 20 18:49:26 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:26 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:26 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-2db89d2d-626b-4d6a-bf49-b139fa9ccc6b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.360966 Apr 20 18:49:26 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 78/230] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:26 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: a235505e-9475-4676-80db-0aef8e52a34c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:33 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] HTTP exception thrown: Instance a235505e-9475-4676-80db-0aef8e52a34c could not be found. Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Request method failure captured: Apr 20 18:49:33 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c HTTP/1.1 Apr 20 18:49:33 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:49:33 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:49:33 user devstack@n-api.service[61668]: Connection: close Apr 20 18:49:33 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:49:33 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:49:33 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:49:33 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:49:33 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgTeu8833dA9KCaC8To7VXbZLMTPdrfqFhkSgYw1CKim6HXoyElnADhrSLooiOFgKB1ekUS0mfE7wyxR3bgEEOhCECipvPq8XTUpcbpH3I31EbpmlbrdneJ62hSXAOIjBm1lCjUPKJTcYI4CmNzOBYvOU1X_W4duGImGTcIz02bFyQ Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Project-Id: e196bf571ed846339e119c1abdc7367e Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Project-Name: tempest-VolumesAdminNegativeTest-1915787388 Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e196bf571ed846339e119c1abdc7367e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e196bf571ed846339e119c1abdc7367e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e196bf571ed846339e119c1abdc7367e"}]}] Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Tenant: tempest-VolumesAdminNegativeTest-1915787388 Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Tenant-Id: e196bf571ed846339e119c1abdc7367e Apr 20 18:49:33 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1915787388 Apr 20 18:49:33 user devstack@n-api.service[61668]: X-User: tempest-VolumesAdminNegativeTest-1915787388-project-member Apr 20 18:49:33 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:49:33 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:49:33 user devstack@n-api.service[61668]: X-User-Id: 24f53ac3fb884290a0b57e68059bf789 Apr 20 18:49:33 user devstack@n-api.service[61668]: X-User-Name: tempest-VolumesAdminNegativeTest-1915787388-project-member Apr 20 18:49:33 user devstack@n-api.service[61668]: method: > Apr 20 18:49:33 user devstack@n-api.service[61668]: exception: Instance a235505e-9475-4676-80db-0aef8e52a34c could not be found. Apr 20 18:49:33 user devstack@n-api.service[61668]: action_args: {'id': 'a235505e-9475-4676-80db-0aef8e52a34c'} Apr 20 18:49:33 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a235505e-9475-4676-80db-0aef8e52a34c could not be found. Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a235505e-9475-4676-80db-0aef8e52a34c could not be found. Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a235505e-9475-4676-80db-0aef8e52a34c could not be found. Apr 20 18:49:33 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:33 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Returning 404 to user: Instance a235505e-9475-4676-80db-0aef8e52a34c could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:49:33 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-dc1856f4-41a5-4b68-a46c-979525023868 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c" status: 404 len: 111 microversion: 2.1 time: 0.031753 Apr 20 18:49:33 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 77/231] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:33 2023] GET /compute/v2.1/servers/a235505e-9475-4676-80db-0aef8e52a34c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:33 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:49:33 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-4c569b60-b54a-462c-a124-22b37fd726f8 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1" status: 204 len: 0 microversion: 2.1 time: 0.137651 Apr 20 18:49:33 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:49:33 2023] DELETE /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:34 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-71379ced-1943-41f6-9c1c-d5e01bd75eb6 req-6200f6b2-e19d-4da5-9e9a-61da15f2b571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "name": "network-vif-unplugged", "status": "completed", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-71379ced-1943-41f6-9c1c-d5e01bd75eb6 req-6200f6b2-e19d-4da5-9e9a-61da15f2b571 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-71379ced-1943-41f6-9c1c-d5e01bd75eb6 req-6200f6b2-e19d-4da5-9e9a-61da15f2b571 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-71379ced-1943-41f6-9c1c-d5e01bd75eb6 req-6200f6b2-e19d-4da5-9e9a-61da15f2b571 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-71379ced-1943-41f6-9c1c-d5e01bd75eb6 req-6200f6b2-e19d-4da5-9e9a-61da15f2b571 service nova] Creating event network-vif-unplugged:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:49:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-71379ced-1943-41f6-9c1c-d5e01bd75eb6 req-6200f6b2-e19d-4da5-9e9a-61da15f2b571 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035936 Apr 20 18:49:34 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:34 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24f53ac3fb884290a0b57e68059bf789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e196bf571ed846339e119c1abdc7367e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-59a02b56-1d41-45ad-b1d7-fdb9f6225c54 tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1" status: 200 len: 1669 microversion: 2.1 time: 0.365548 Apr 20 18:49:34 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:49:33 2023] GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1 => generated 1669 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:49:35 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-642b700e-5ef0-4f75-bc02-4e454db2905e req-d5f7fbb0-e367-4f32-b652-ec4d16e67592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "name": "network-vif-deleted", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-642b700e-5ef0-4f75-bc02-4e454db2905e req-d5f7fbb0-e367-4f32-b652-ec4d16e67592 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-642b700e-5ef0-4f75-bc02-4e454db2905e req-d5f7fbb0-e367-4f32-b652-ec4d16e67592 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-642b700e-5ef0-4f75-bc02-4e454db2905e req-d5f7fbb0-e367-4f32-b652-ec4d16e67592 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:35 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-642b700e-5ef0-4f75-bc02-4e454db2905e req-d5f7fbb0-e367-4f32-b652-ec4d16e67592 service nova] Creating event network-vif-deleted:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:49:35 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-642b700e-5ef0-4f75-bc02-4e454db2905e req-d5f7fbb0-e367-4f32-b652-ec4d16e67592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030933 Apr 20 18:49:35 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 78/235] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:36 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-3a2c3660-5112-4802-a3ae-f99b1722ff80 req-10a4e142-e4c3-4ec7-bf46-99328861da84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c39aa739-e627-4da5-849f-ecbbe765b0d1", "name": "network-vif-plugged", "status": "completed", "tag": "26ab32c3-7820-4e38-a046-abe850ca8de4"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:36 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-3a2c3660-5112-4802-a3ae-f99b1722ff80 req-10a4e142-e4c3-4ec7-bf46-99328861da84 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:36 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-3a2c3660-5112-4802-a3ae-f99b1722ff80 req-10a4e142-e4c3-4ec7-bf46-99328861da84 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:36 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-3a2c3660-5112-4802-a3ae-f99b1722ff80 req-10a4e142-e4c3-4ec7-bf46-99328861da84 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:36 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-3a2c3660-5112-4802-a3ae-f99b1722ff80 req-10a4e142-e4c3-4ec7-bf46-99328861da84 service nova] Creating event network-vif-plugged:26ab32c3-7820-4e38-a046-abe850ca8de4 for instance c39aa739-e627-4da5-849f-ecbbe765b0d1 on user Apr 20 18:49:36 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-3a2c3660-5112-4802-a3ae-f99b1722ff80 req-10a4e142-e4c3-4ec7-bf46-99328861da84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 Apr 20 18:49:36 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 79/236] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG nova.objects.instance [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lazy-loading 'fault' on Instance uuid 68899b59-93c7-429f-9bc2-0eea1b3099b2 {{(pid=61667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:41 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:41 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-1dc95df0-f361-429f-b533-c75f5691019c tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2" status: 200 len: 1648 microversion: 2.87 time: 0.413678 Apr 20 18:49:41 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 80/237] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:49:41 2023] GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2 => generated 1648 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Doing local delete in cell e570c5e4-d2bb-4eb5-ba69-c1c987d683f8(cell1) {{(pid=61666) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:41 user devstack@n-api.service[61666]: WARNING nova.compute.api [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] instance's host None is down, deleting from database Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] deallocate_for_instance() {{(pid=61666) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Instance cache missing network info. {{(pid=61666) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Updating instance_info_cache with network_info: [] {{(pid=61666) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 18:49:41 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61666) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 18:49:41 user devstack@n-api.service[61666]: WARNING nova.compute.api [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 18:49:42 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-6239e978-c8e7-4f14-8e4f-a144b07decd9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2" status: 204 len: 0 microversion: 2.87 time: 0.734983 Apr 20 18:49:42 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 79/238] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:49:41 2023] DELETE /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 68899b59-93c7-429f-9bc2-0eea1b3099b2] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=27 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:42 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] HTTP exception thrown: Instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 could not be found. Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Request method failure captured: Apr 20 18:49:42 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2 HTTP/1.1 Apr 20 18:49:42 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:49:42 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:49:42 user devstack@n-api.service[61668]: Connection: close Apr 20 18:49:42 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:49:42 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:49:42 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:49:42 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:49:42 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYhgtRIezK7bo8fL0O4MwlXym_N9uexdl5NNIrHv_yCUFgMBygqXb84uAIXnTc5SgF-tEvBvDnbF288ry4gLHZmI5P7Va7IfK4k7GX-d-YDy02SY1Uf6P8q3OGgTEFCJsEW0HEhxW45k5pXInKLVEn94CPziJ-8a3wpG1UKY7XwcJDg Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Project-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455e6c598311404f90884c282f25c9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}] Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Tenant-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:49:42 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:49:42 user devstack@n-api.service[61668]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:49:42 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:49:42 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:49:42 user devstack@n-api.service[61668]: X-User-Id: 1332e51aa657411cb00f200b592c39f1 Apr 20 18:49:42 user devstack@n-api.service[61668]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:49:42 user devstack@n-api.service[61668]: method: > Apr 20 18:49:42 user devstack@n-api.service[61668]: exception: Instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 could not be found. Apr 20 18:49:42 user devstack@n-api.service[61668]: action_args: {'id': '68899b59-93c7-429f-9bc2-0eea1b3099b2'} Apr 20 18:49:42 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 could not be found. Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 could not be found. Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 could not be found. Apr 20 18:49:42 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:49:42 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Returning 404 to user: Instance 68899b59-93c7-429f-9bc2-0eea1b3099b2 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:49:42 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-2fbf77b9-2dd2-45b5-86a1-ee1f0a44d80e tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2" status: 404 len: 111 microversion: 2.87 time: 0.041059 Apr 20 18:49:42 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 80/239] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:49:42 2023] GET /compute/v2.1/servers/68899b59-93c7-429f-9bc2-0eea1b3099b2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:49:42 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-199080343", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "507056ae-4667-4837-80d1-49f642249cfa"}]}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:42 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] validate_networks() for [('507056ae-4667-4837-80d1-49f642249cfa', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for user 1332e51aa657411cb00f200b592c39f1 and project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:49:43 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:49:43 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-d70222b5-a870-4683-9dff-3524d95addd1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.806431 Apr 20 18:49:43 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 81/240] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 18:49:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 18:49:43 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-bde79835-812b-4f5e-8e1a-68de0d960c83 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:43 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-bde79835-812b-4f5e-8e1a-68de0d960c83 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:49:43 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-bde79835-812b-4f5e-8e1a-68de0d960c83 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:43 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-bde79835-812b-4f5e-8e1a-68de0d960c83 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:43 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-bde79835-812b-4f5e-8e1a-68de0d960c83 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:49:43 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-bde79835-812b-4f5e-8e1a-68de0d960c83 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93" status: 200 len: 1394 microversion: 2.87 time: 0.080229 Apr 20 18:49:43 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 80/241] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:49:43 2023] GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 => generated 1394 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:49:46 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-fb723f02-2b3a-4c61-a724-c6c3eabf222c req-94781cba-0747-4636-a5ea-130e38cfedf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0053eb-2b6f-46b5-8b72-cd9b1f322d93", "tag": "9e44348e-22b8-4cfb-81a3-f952725f35f9"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-fb723f02-2b3a-4c61-a724-c6c3eabf222c req-94781cba-0747-4636-a5ea-130e38cfedf2 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-fb723f02-2b3a-4c61-a724-c6c3eabf222c req-94781cba-0747-4636-a5ea-130e38cfedf2 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-fb723f02-2b3a-4c61-a724-c6c3eabf222c req-94781cba-0747-4636-a5ea-130e38cfedf2 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:46 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-fb723f02-2b3a-4c61-a724-c6c3eabf222c req-94781cba-0747-4636-a5ea-130e38cfedf2 service nova] Creating event network-changed:9e44348e-22b8-4cfb-81a3-f952725f35f9 for instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 on user Apr 20 18:49:46 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-fb723f02-2b3a-4c61-a724-c6c3eabf222c req-94781cba-0747-4636-a5ea-130e38cfedf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207455 Apr 20 18:49:46 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 81/242] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:48 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-ceacfa60-593d-4b6a-a7dd-e3a9ff8e8128 req-05c795d1-3f72-43e4-97a3-00cf01cf1a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0053eb-2b6f-46b5-8b72-cd9b1f322d93", "name": "network-vif-plugged", "status": "completed", "tag": "9e44348e-22b8-4cfb-81a3-f952725f35f9"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:48 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ceacfa60-593d-4b6a-a7dd-e3a9ff8e8128 req-05c795d1-3f72-43e4-97a3-00cf01cf1a6d service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:48 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ceacfa60-593d-4b6a-a7dd-e3a9ff8e8128 req-05c795d1-3f72-43e4-97a3-00cf01cf1a6d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:48 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-ceacfa60-593d-4b6a-a7dd-e3a9ff8e8128 req-05c795d1-3f72-43e4-97a3-00cf01cf1a6d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:48 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-ceacfa60-593d-4b6a-a7dd-e3a9ff8e8128 req-05c795d1-3f72-43e4-97a3-00cf01cf1a6d service nova] Creating event network-vif-plugged:9e44348e-22b8-4cfb-81a3-f952725f35f9 for instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 on user Apr 20 18:49:48 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-ceacfa60-593d-4b6a-a7dd-e3a9ff8e8128 req-05c795d1-3f72-43e4-97a3-00cf01cf1a6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063455 Apr 20 18:49:48 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 82/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:50 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-0345467f-2531-4db7-9b0a-71c05a784653 req-da3a6a00-b0f3-4fae-9875-0c6a938b1c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0053eb-2b6f-46b5-8b72-cd9b1f322d93", "name": "network-vif-plugged", "status": "completed", "tag": "9e44348e-22b8-4cfb-81a3-f952725f35f9"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:50 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-0345467f-2531-4db7-9b0a-71c05a784653 req-da3a6a00-b0f3-4fae-9875-0c6a938b1c30 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:49:50 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-0345467f-2531-4db7-9b0a-71c05a784653 req-da3a6a00-b0f3-4fae-9875-0c6a938b1c30 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:49:50 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-0345467f-2531-4db7-9b0a-71c05a784653 req-da3a6a00-b0f3-4fae-9875-0c6a938b1c30 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:49:50 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-0345467f-2531-4db7-9b0a-71c05a784653 req-da3a6a00-b0f3-4fae-9875-0c6a938b1c30 service nova] Creating event network-vif-plugged:9e44348e-22b8-4cfb-81a3-f952725f35f9 for instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 on user Apr 20 18:49:50 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-0345467f-2531-4db7-9b0a-71c05a784653 req-da3a6a00-b0f3-4fae-9875-0c6a938b1c30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Apr 20 18:49:50 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 81/244] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:49:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:54 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-38c20ab8-3339-4af8-914c-76f71d613ca5 tempest-TestVolumeBootPattern-1682225692 tempest-TestVolumeBootPattern-1682225692-project-member] Action: 'create', calling method: .version_select at 0x7fe63ea3dbd0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1694135108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpsJ3riDr0ZdO7avz5ml5RBcqV+rHdsGpFLm8NaEJIcoGeorxLvvuOdsiQsITvuoHcPw9Am1JDzv/AA75qfXbUAxMH7exaAA8SOCkZpTqneD8w2Jd8XFC/a3GfF1tNKeg=="}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:49:54 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-38c20ab8-3339-4af8-914c-76f71d613ca5 tempest-TestVolumeBootPattern-1682225692 tempest-TestVolumeBootPattern-1682225692-project-member] Getting quotas for project 20acb38fd11a4873ba44f8a5d36bdbc2. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:49:54 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-38c20ab8-3339-4af8-914c-76f71d613ca5 tempest-TestVolumeBootPattern-1682225692 tempest-TestVolumeBootPattern-1682225692-project-member] Getting quotas for user eaedf644fe544b8ebf4a43be29f1f0e3 and project 20acb38fd11a4873ba44f8a5d36bdbc2. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:49:54 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-38c20ab8-3339-4af8-914c-76f71d613ca5 tempest-TestVolumeBootPattern-1682225692 tempest-TestVolumeBootPattern-1682225692-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.045630 Apr 20 18:49:54 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 82/245] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:49:54 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:49:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-fc64f014-189d-4407-a605-b3dde9c21463 tempest-TestVolumeBootPattern-1682225692 tempest-TestVolumeBootPattern-1682225692-project-member] Calling method '.version_select at 0x7fe63eb909d0>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:49:57 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:57 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:49:57 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-fc64f014-189d-4407-a605-b3dde9c21463 tempest-TestVolumeBootPattern-1682225692 tempest-TestVolumeBootPattern-1682225692-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1694135108" status: 202 len: 0 microversion: 2.1 time: 0.038917 Apr 20 18:49:57 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 20 18:49:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1694135108 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:03 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] HTTP exception thrown: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Request method failure captured: Apr 20 18:50:03 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 HTTP/1.1 Apr 20 18:50:03 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:50:03 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:50:03 user devstack@n-api.service[61666]: Connection: close Apr 20 18:50:03 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:50:03 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:50:03 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:50:03 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:50:03 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhI9edPU5II-4d4mNWGxPmTqjtD8NnS2daJPgJy5-saoGWFv0D541uLwbwMSwJMgEJSyeCBNMmQ9Fl-EHS_b3BQHP_x5WEBQfrdlm2qqr8KPkR21Bd47WbBvyiF3wSDze65gb9mhC-VZE1VdJyF4w1eB8qlMooFMAcIIhVM_APN1FY Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Project-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Project-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33f79038404f4e02974038c4e127abc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}] Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Tenant: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Tenant-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:50:03 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:50:03 user devstack@n-api.service[61666]: X-User: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:50:03 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:50:03 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:50:03 user devstack@n-api.service[61666]: X-User-Id: 8809171383a24c6d9c5b6d7185b59f8f Apr 20 18:50:03 user devstack@n-api.service[61666]: X-User-Name: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:50:03 user devstack@n-api.service[61666]: method: > Apr 20 18:50:03 user devstack@n-api.service[61666]: exception: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:50:03 user devstack@n-api.service[61666]: action_args: {'id': '723ae2f4-e57d-4a56-8121-d27dc0e79869'} Apr 20 18:50:03 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:50:03 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:03 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Returning 404 to user: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:50:03 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7ba1ff6e-e8a3-4122-a6c1-0937b656d10f tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 404 len: 111 microversion: 2.1 time: 0.049208 Apr 20 18:50:03 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 82/247] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:03 2023] GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:03 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:03 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-6fbd3881-5a08-4278-826e-a61ba2c7860a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1494 microversion: 2.1 time: 0.271908 Apr 20 18:50:03 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 83/248] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:03 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1494 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=11 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:07 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-3748b94e-74cf-48b8-9dcd-b79c43de5c59 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.160454 Apr 20 18:50:07 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 84/249] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:50:07 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:08 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:08 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-db265466-71fc-4ba3-8f79-95fde1db2047 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237/ips" status: 200 len: 105 microversion: 2.1 time: 0.039041 Apr 20 18:50:08 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 85/250] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:50:08 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237/ips => generated 105 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:08 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-dbf38eda-c922-450d-9601-44f2fe8b1d1c req-62042eef-40cc-4bb8-a3db-351275f38272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:50:08 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 HTTP/1.1 Apr 20 18:50:08 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:50:08 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:50:08 user devstack@n-api.service[61666]: Connection: close Apr 20 18:50:08 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:50:08 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:50:08 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:50:08 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:50:08 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:50:08 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:50:08 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:50:08 user devstack@n-api.service[61666]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:50:08 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:50:08 user devstack@n-api.service[61666]: method: > Apr 20 18:50:08 user devstack@n-api.service[61666]: exception: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:50:08 user devstack@n-api.service[61666]: action_args: {'id': 'cd303dc8-9628-437c-a220-109b96c258e9'} Apr 20 18:50:08 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:50:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:50:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:50:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-dbf38eda-c922-450d-9601-44f2fe8b1d1c req-62042eef-40cc-4bb8-a3db-351275f38272 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-dbf38eda-c922-450d-9601-44f2fe8b1d1c req-62042eef-40cc-4bb8-a3db-351275f38272 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-dbf38eda-c922-450d-9601-44f2fe8b1d1c req-62042eef-40cc-4bb8-a3db-351275f38272 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-14f19d8c-450e-49de-bb2f-b2090f19c30e tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 404 len: 111 microversion: 2.1 time: 0.246298 Apr 20 18:50:08 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 83/251] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:08 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:50:08 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-c256c33e-54d8-4523-841e-bbdfa6d20d50 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '.version_select at 0x7fe63eb90700>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-dbf38eda-c922-450d-9601-44f2fe8b1d1c req-62042eef-40cc-4bb8-a3db-351275f38272 service nova] Creating event network-changed:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:50:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-dbf38eda-c922-450d-9601-44f2fe8b1d1c req-62042eef-40cc-4bb8-a3db-351275f38272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160880 Apr 20 18:50:08 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 84/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:08 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-c256c33e-54d8-4523-841e-bbdfa6d20d50 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487550582" status: 202 len: 0 microversion: 2.1 time: 0.030782 Apr 20 18:50:08 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 86/253] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 18:50:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487550582 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:50:09 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-0e623411-24b7-4c0e-87e8-25b9a6dc212b tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Action: 'create', calling method: .version_select at 0x7fe63e981990>, body: {"keypair": {"name": "tempest-keypair-225891191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnqgMW+VvFDg76y1yya8STKoFcPe/XfheIRcuJ1SNPXJN4XO5DvYg5lorRzvkF70ybNebvR6+46raP+bex6JYRpqQD8dRX+u935ZJ5QzRiMc45d9FKWovAujmwiBA4Pyg=="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:09 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-0e623411-24b7-4c0e-87e8-25b9a6dc212b tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:50:09 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-0e623411-24b7-4c0e-87e8-25b9a6dc212b tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for user 2c6275ba3d2249c7a04952e5726bb633 and project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:50:09 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-0e623411-24b7-4c0e-87e8-25b9a6dc212b tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058176 Apr 20 18:50:09 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 84/254] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:50:09 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:09 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:50:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-de3101d6-2353-42da-a460-6e0ececb601e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 204 len: 0 microversion: 2.1 time: 0.128780 Apr 20 18:50:10 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 85/255] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:50:09 2023] DELETE /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: a0332417-891a-4c2a-bd86-b2fad86f7df9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] HTTP exception thrown: Instance a0332417-891a-4c2a-bd86-b2fad86f7df9 could not be found. Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Request method failure captured: Apr 20 18:50:10 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 HTTP/1.1 Apr 20 18:50:10 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:50:10 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:50:10 user devstack@n-api.service[61667]: Connection: close Apr 20 18:50:10 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:50:10 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:50:10 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:50:10 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:50:10 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYgKBqxyunZhmEuF1_hLdGKHfogWx03PkPx6EyQAzmF2wWQpe2vqNPZ7XM4OEQvc7wcDjo4BbElgLcNjuDgactg9HOj2kN0uF9UWoeEbixeqWJDl9xW42eRqXeuYaJq-cqkcNYceW7rUP2BdYDA2gHb3R5oF8I5_T821W2hZybAZikk Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Project-Id: 641b4a94c3114312ae2f8b3658921374 Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1808078690 Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/641b4a94c3114312ae2f8b3658921374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/641b4a94c3114312ae2f8b3658921374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/641b4a94c3114312ae2f8b3658921374"}]}] Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1808078690 Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Tenant-Id: 641b4a94c3114312ae2f8b3658921374 Apr 20 18:50:10 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1808078690 Apr 20 18:50:10 user devstack@n-api.service[61667]: X-User: tempest-ServerRescueNegativeTestJSON-1808078690-project-member Apr 20 18:50:10 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:50:10 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:50:10 user devstack@n-api.service[61667]: X-User-Id: e33a2234ce2640f59dbf4dc4e693b0af Apr 20 18:50:10 user devstack@n-api.service[61667]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1808078690-project-member Apr 20 18:50:10 user devstack@n-api.service[61667]: method: > Apr 20 18:50:10 user devstack@n-api.service[61667]: exception: Instance a0332417-891a-4c2a-bd86-b2fad86f7df9 could not be found. Apr 20 18:50:10 user devstack@n-api.service[61667]: action_args: {'id': 'a0332417-891a-4c2a-bd86-b2fad86f7df9'} Apr 20 18:50:10 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0332417-891a-4c2a-bd86-b2fad86f7df9 could not be found. Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0332417-891a-4c2a-bd86-b2fad86f7df9 could not be found. Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0332417-891a-4c2a-bd86-b2fad86f7df9 could not be found. Apr 20 18:50:10 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Returning 404 to user: Instance a0332417-891a-4c2a-bd86-b2fad86f7df9 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:50:10 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-ca329114-46bb-4c22-8287-64cb18cf76c3 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9" status: 404 len: 111 microversion: 2.1 time: 0.228643 Apr 20 18:50:10 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 87/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:09 2023] GET /compute/v2.1/servers/a0332417-891a-4c2a-bd86-b2fad86f7df9 => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10dd79d3683e4780b76f0f2d9b6aefae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eebb7c6a8414543b3d9c5830fddb2c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:10 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-02f54621-ece1-4b82-a28d-046703159e64 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 200 len: 1661 microversion: 2.1 time: 0.312843 Apr 20 18:50:10 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:10 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 1661 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:50:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-980be8e7-6210-4d64-820c-2cf41c63045f tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9" status: 204 len: 0 microversion: 2.1 time: 0.137949 Apr 20 18:50:10 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 86/258] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:50:10 2023] DELETE /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-7c829fc5-095b-4257-82fe-78f552810f8d req-77ae707f-b9dd-45d0-808e-21ef762ebc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ed527-b7b4-49d3-96b9-2268663c39b9", "name": "network-vif-unplugged", "status": "completed", "tag": "032a5536-b87d-448c-b618-38d1b0c6b548"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-7c829fc5-095b-4257-82fe-78f552810f8d req-77ae707f-b9dd-45d0-808e-21ef762ebc0e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-7c829fc5-095b-4257-82fe-78f552810f8d req-77ae707f-b9dd-45d0-808e-21ef762ebc0e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-7c829fc5-095b-4257-82fe-78f552810f8d req-77ae707f-b9dd-45d0-808e-21ef762ebc0e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-7c829fc5-095b-4257-82fe-78f552810f8d req-77ae707f-b9dd-45d0-808e-21ef762ebc0e service nova] Creating event network-vif-unplugged:032a5536-b87d-448c-b618-38d1b0c6b548 for instance 873ed527-b7b4-49d3-96b9-2268663c39b9 on user Apr 20 18:50:10 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-7c829fc5-095b-4257-82fe-78f552810f8d req-77ae707f-b9dd-45d0-808e-21ef762ebc0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028242 Apr 20 18:50:10 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 86/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "name": "network-vif-unplugged", "status": "completed", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}, {"server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "name": "network-vif-plugged", "status": "completed", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:10 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e33a2234ce2640f59dbf4dc4e693b0af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641b4a94c3114312ae2f8b3658921374', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] Creating event network-vif-unplugged:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:50:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] Creating event network-vif-plugged:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:50:10 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-b0d9f198-909a-4a5f-b7d3-8ec656945546 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9" status: 200 len: 1509 microversion: 2.1 time: 0.304814 Apr 20 18:50:10 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 88/260] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:10 2023] GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9 => generated 1509 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-775260fa-1252-4a19-8a87-38cefe687d1a req-1ac3863b-3e1e-416b-acc7-101a0ed3f272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.051782 Apr 20 18:50:10 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 87/261] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:11 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-659063752", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "dfac52da-60b6-4928-a243-f139eab2b8da"}], "security_groups": [{"name": "tempest-securitygroup--2069847431"}], "key_name": "tempest-keypair-225891191", "user_data": "}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:11 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] validate_networks() for [('dfac52da-60b6-4928-a243-f139eab2b8da', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-0e1fec76-3cd3-4206-81db-71054161f467 req-883c29a5-81a0-4d9f-9809-dea7a4a76d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ed527-b7b4-49d3-96b9-2268663c39b9", "name": "network-vif-plugged", "status": "completed", "tag": "032a5536-b87d-448c-b618-38d1b0c6b548"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-0e1fec76-3cd3-4206-81db-71054161f467 req-883c29a5-81a0-4d9f-9809-dea7a4a76d30 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-0e1fec76-3cd3-4206-81db-71054161f467 req-883c29a5-81a0-4d9f-9809-dea7a4a76d30 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-0e1fec76-3cd3-4206-81db-71054161f467 req-883c29a5-81a0-4d9f-9809-dea7a4a76d30 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:12 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-0e1fec76-3cd3-4206-81db-71054161f467 req-883c29a5-81a0-4d9f-9809-dea7a4a76d30 service nova] Creating event network-vif-plugged:032a5536-b87d-448c-b618-38d1b0c6b548 for instance 873ed527-b7b4-49d3-96b9-2268663c39b9 on user Apr 20 18:50:12 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-0e1fec76-3cd3-4206-81db-71054161f467 req-883c29a5-81a0-4d9f-9809-dea7a4a76d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034709 Apr 20 18:50:12 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 89/262] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Getting quotas for user 2c6275ba3d2249c7a04952e5726bb633 and project 8be777a9cd424d42ae9caae453cb2e52. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:50:12 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:50:12 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-534c0461-b8a6-4f8e-89e0-0507b7955645 req-cacc239c-d74b-454c-8997-e830bbb3620d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873ed527-b7b4-49d3-96b9-2268663c39b9", "name": "network-vif-deleted", "tag": "032a5536-b87d-448c-b618-38d1b0c6b548"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-534c0461-b8a6-4f8e-89e0-0507b7955645 req-cacc239c-d74b-454c-8997-e830bbb3620d service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-534c0461-b8a6-4f8e-89e0-0507b7955645 req-cacc239c-d74b-454c-8997-e830bbb3620d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-534c0461-b8a6-4f8e-89e0-0507b7955645 req-cacc239c-d74b-454c-8997-e830bbb3620d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:12 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-534c0461-b8a6-4f8e-89e0-0507b7955645 req-cacc239c-d74b-454c-8997-e830bbb3620d service nova] Creating event network-vif-deleted:032a5536-b87d-448c-b618-38d1b0c6b548 for instance 873ed527-b7b4-49d3-96b9-2268663c39b9 on user Apr 20 18:50:12 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-534c0461-b8a6-4f8e-89e0-0507b7955645 req-cacc239c-d74b-454c-8997-e830bbb3620d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 Apr 20 18:50:12 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 88/263] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:12 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-3faf50de-db10-497f-9e75-704b4816f364 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.625216 Apr 20 18:50:12 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 87/264] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:50:11 2023] POST /compute/v2.1/servers => generated 400 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-0035a93a-7a92-4949-ba36-84b92c0ef732 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-0035a93a-7a92-4949-ba36-84b92c0ef732 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:12 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-0035a93a-7a92-4949-ba36-84b92c0ef732 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:12 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-0035a93a-7a92-4949-ba36-84b92c0ef732 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 200 len: 1234 microversion: 2.1 time: 0.090978 Apr 20 18:50:12 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 90/265] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:12 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 1234 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:14 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-ff90b1bc-b8e9-4ae1-80d3-8ca7ba915f86 req-591875ac-3e7f-46fd-8b76-1a1e3236f46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92bb6d66-5883-449a-9bd1-8668a7877237", "name": "network-vif-deleted", "tag": "479accb6-774b-4c04-9bb7-3c63d8bf9067"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-ff90b1bc-b8e9-4ae1-80d3-8ca7ba915f86 req-591875ac-3e7f-46fd-8b76-1a1e3236f46e service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-ff90b1bc-b8e9-4ae1-80d3-8ca7ba915f86 req-591875ac-3e7f-46fd-8b76-1a1e3236f46e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-ff90b1bc-b8e9-4ae1-80d3-8ca7ba915f86 req-591875ac-3e7f-46fd-8b76-1a1e3236f46e service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:14 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-ff90b1bc-b8e9-4ae1-80d3-8ca7ba915f86 req-591875ac-3e7f-46fd-8b76-1a1e3236f46e service nova] Creating event network-vif-deleted:479accb6-774b-4c04-9bb7-3c63d8bf9067 for instance 92bb6d66-5883-449a-9bd1-8668a7877237 on user Apr 20 18:50:14 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-ff90b1bc-b8e9-4ae1-80d3-8ca7ba915f86 req-591875ac-3e7f-46fd-8b76-1a1e3236f46e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032730 Apr 20 18:50:14 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 89/266] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:16 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-381043f1-b71f-4545-8cce-df677344c640 req-60bb2143-9c4e-4441-a86d-2e87abe9dfef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:16 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-381043f1-b71f-4545-8cce-df677344c640 req-60bb2143-9c4e-4441-a86d-2e87abe9dfef service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:16 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-381043f1-b71f-4545-8cce-df677344c640 req-60bb2143-9c4e-4441-a86d-2e87abe9dfef service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:16 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-381043f1-b71f-4545-8cce-df677344c640 req-60bb2143-9c4e-4441-a86d-2e87abe9dfef service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:16 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-381043f1-b71f-4545-8cce-df677344c640 req-60bb2143-9c4e-4441-a86d-2e87abe9dfef service nova] Creating event network-changed:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:50:16 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-381043f1-b71f-4545-8cce-df677344c640 req-60bb2143-9c4e-4441-a86d-2e87abe9dfef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030306 Apr 20 18:50:16 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 88/267] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:18 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "name": "network-vif-plugged", "status": "completed", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}, {"server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "name": "network-vif-plugged", "status": "completed", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:18 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:18 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:18 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:18 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] Creating event network-vif-plugged:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:50:18 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] Creating event network-vif-plugged:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:50:18 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-55c90dcd-b369-493e-a9ca-e312f7cb4185 req-2717dced-ac0e-4c3b-a0e1-ad889ec5d3ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057685 Apr 20 18:50:18 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 91/268] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] [instance: c39aa739-e627-4da5-849f-ecbbe765b0d1] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:24 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] HTTP exception thrown: Instance c39aa739-e627-4da5-849f-ecbbe765b0d1 could not be found. Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Request method failure captured: Apr 20 18:50:24 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1 HTTP/1.1 Apr 20 18:50:24 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:50:24 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:50:24 user devstack@n-api.service[61668]: Connection: close Apr 20 18:50:24 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:50:24 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:50:24 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:50:24 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:50:24 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgTeu8833dA9KCaC8To7VXbZLMTPdrfqFhkSgYw1CKim6HXoyElnADhrSLooiOFgKB1ekUS0mfE7wyxR3bgEEOhCECipvPq8XTUpcbpH3I31EbpmlbrdneJ62hSXAOIjBm1lCjUPKJTcYI4CmNzOBYvOU1X_W4duGImGTcIz02bFyQ Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Project-Id: e196bf571ed846339e119c1abdc7367e Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Project-Name: tempest-VolumesAdminNegativeTest-1915787388 Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e196bf571ed846339e119c1abdc7367e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e196bf571ed846339e119c1abdc7367e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e196bf571ed846339e119c1abdc7367e"}]}] Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Tenant: tempest-VolumesAdminNegativeTest-1915787388 Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Tenant-Id: e196bf571ed846339e119c1abdc7367e Apr 20 18:50:24 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1915787388 Apr 20 18:50:24 user devstack@n-api.service[61668]: X-User: tempest-VolumesAdminNegativeTest-1915787388-project-member Apr 20 18:50:24 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:50:24 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:50:24 user devstack@n-api.service[61668]: X-User-Id: 24f53ac3fb884290a0b57e68059bf789 Apr 20 18:50:24 user devstack@n-api.service[61668]: X-User-Name: tempest-VolumesAdminNegativeTest-1915787388-project-member Apr 20 18:50:24 user devstack@n-api.service[61668]: method: > Apr 20 18:50:24 user devstack@n-api.service[61668]: exception: Instance c39aa739-e627-4da5-849f-ecbbe765b0d1 could not be found. Apr 20 18:50:24 user devstack@n-api.service[61668]: action_args: {'id': 'c39aa739-e627-4da5-849f-ecbbe765b0d1'} Apr 20 18:50:24 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c39aa739-e627-4da5-849f-ecbbe765b0d1 could not be found. Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c39aa739-e627-4da5-849f-ecbbe765b0d1 could not be found. Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c39aa739-e627-4da5-849f-ecbbe765b0d1 could not be found. Apr 20 18:50:24 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:50:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Returning 404 to user: Instance c39aa739-e627-4da5-849f-ecbbe765b0d1 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:50:24 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-4bf0a93f-1a6c-4dec-9208-052529aa667f tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1" status: 404 len: 111 microversion: 2.1 time: 0.129918 Apr 20 18:50:24 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 90/269] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:24 2023] GET /compute/v2.1/servers/c39aa739-e627-4da5-849f-ecbbe765b0d1 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:50:24 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:24 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=10 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-a9be6fd7-5a56-4d83-9e5c-3c3da76a19ab tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] Calling method '.version_select at 0x7fe63e981480>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-a9be6fd7-5a56-4d83-9e5c-3c3da76a19ab tempest-VolumesAdminNegativeTest-1915787388 tempest-VolumesAdminNegativeTest-1915787388-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938327927" status: 202 len: 0 microversion: 2.1 time: 0.025634 Apr 20 18:50:24 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 89/270] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 18:50:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1938327927 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:28 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:28 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-86658c39-f442-49de-956f-54bed793ad16 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.270023 Apr 20 18:50:28 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 92/271] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:50:28 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:33 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:33 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-3bc51ee0-51e7-4d41-ae71-fb87ffa4c6d1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93" status: 200 len: 1688 microversion: 2.87 time: 0.262250 Apr 20 18:50:33 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 91/272] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:50:33 2023] GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 => generated 1688 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:50:39 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=16 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:39 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:39 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2377c9a9-acd1-44a4-a4a2-ac5d4207fefe tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Action: 'create', calling method: .version_select at 0x7fe63e980e50>, body: {"keypair": {"name": "tempest-keypair-530111901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRAha/pJfYEJk9pU7ummmOqCjraVzXFUTnaY8s78tYGEjn71ePHwMwts5AUiloVSn5vavIm2/86oufYkttYwqhXh6+ul3UEbH3TuMXoRsVD8QNwGJWQWhBjbkLhYAGu3Q=="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:39 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-2377c9a9-acd1-44a4-a4a2-ac5d4207fefe tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for project 27ae1955293e49b5a61280cee2084292. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:50:39 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-2377c9a9-acd1-44a4-a4a2-ac5d4207fefe tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for user 3f1d66bdeebc4100a788e4e8b81eacb8 and project 27ae1955293e49b5a61280cee2084292. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:50:39 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-2377c9a9-acd1-44a4-a4a2-ac5d4207fefe tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.160987 Apr 20 18:50:39 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 90/273] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 18:50:39 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 18:50:40 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1326945796", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0a0503d2-448c-47a3-b579-3c77d3872041"}], "security_groups": [{"name": "tempest-securitygroup--1263523170"}], "key_name": "tempest-keypair-530111901", "user_data": "}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:40 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=9 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:40 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=26 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] validate_networks() for [('0a0503d2-448c-47a3-b579-3c77d3872041', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for project 27ae1955293e49b5a61280cee2084292. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for user 3f1d66bdeebc4100a788e4e8b81eacb8 and project 27ae1955293e49b5a61280cee2084292. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:50:41 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:50:41 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-df78fbba-392d-427a-a7bb-37b743b2d59f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.608785 Apr 20 18:50:41 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 93/274] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 18:50:40 2023] POST /compute/v2.1/servers => generated 400 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 18:50:41 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-a1867079-53e4-4809-90d1-59786bfc24df tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:50:41 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-a1867079-53e4-4809-90d1-59786bfc24df tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:50:41 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-a1867079-53e4-4809-90d1-59786bfc24df tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:41 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-a1867079-53e4-4809-90d1-59786bfc24df tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:41 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-a1867079-53e4-4809-90d1-59786bfc24df tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:50:41 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-a1867079-53e4-4809-90d1-59786bfc24df tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 200 len: 1275 microversion: 2.20 time: 0.076531 Apr 20 18:50:41 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 92/275] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:50:41 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 1275 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:50:44 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-244cc4a5-a776-4350-8fe0-c86c7a45c695 req-cefd7bc8-cee5-4e8a-8206-4f695013c941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:44 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-244cc4a5-a776-4350-8fe0-c86c7a45c695 req-cefd7bc8-cee5-4e8a-8206-4f695013c941 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:44 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-244cc4a5-a776-4350-8fe0-c86c7a45c695 req-cefd7bc8-cee5-4e8a-8206-4f695013c941 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:44 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-244cc4a5-a776-4350-8fe0-c86c7a45c695 req-cefd7bc8-cee5-4e8a-8206-4f695013c941 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:44 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-244cc4a5-a776-4350-8fe0-c86c7a45c695 req-cefd7bc8-cee5-4e8a-8206-4f695013c941 service nova] Creating event network-changed:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:50:44 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-244cc4a5-a776-4350-8fe0-c86c7a45c695 req-cefd7bc8-cee5-4e8a-8206-4f695013c941 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030516 Apr 20 18:50:44 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 91/276] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:46 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-51c374f9-4702-4690-863a-c3d3a79593c9 req-c78bbcb9-d884-4e08-a3bf-f902b911b9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-plugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:46 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-51c374f9-4702-4690-863a-c3d3a79593c9 req-c78bbcb9-d884-4e08-a3bf-f902b911b9f1 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:46 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-51c374f9-4702-4690-863a-c3d3a79593c9 req-c78bbcb9-d884-4e08-a3bf-f902b911b9f1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:46 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-51c374f9-4702-4690-863a-c3d3a79593c9 req-c78bbcb9-d884-4e08-a3bf-f902b911b9f1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:46 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-51c374f9-4702-4690-863a-c3d3a79593c9 req-c78bbcb9-d884-4e08-a3bf-f902b911b9f1 service nova] Creating event network-vif-plugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:50:46 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-51c374f9-4702-4690-863a-c3d3a79593c9 req-c78bbcb9-d884-4e08-a3bf-f902b911b9f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046041 Apr 20 18:50:46 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 94/277] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:50:48 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-dee2ef62-fc02-4e28-a997-f461c0ad7c35 req-8790d40f-eee8-4095-95b0-516e8dc63771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-plugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:50:48 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:50:48 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-dee2ef62-fc02-4e28-a997-f461c0ad7c35 req-8790d40f-eee8-4095-95b0-516e8dc63771 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:50:48 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-dee2ef62-fc02-4e28-a997-f461c0ad7c35 req-8790d40f-eee8-4095-95b0-516e8dc63771 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:50:48 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-dee2ef62-fc02-4e28-a997-f461c0ad7c35 req-8790d40f-eee8-4095-95b0-516e8dc63771 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:50:48 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-dee2ef62-fc02-4e28-a997-f461c0ad7c35 req-8790d40f-eee8-4095-95b0-516e8dc63771 service nova] Creating event network-vif-plugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:50:48 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-dee2ef62-fc02-4e28-a997-f461c0ad7c35 req-8790d40f-eee8-4095-95b0-516e8dc63771 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030786 Apr 20 18:50:48 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 93/278] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:50:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=4 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:00 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] HTTP exception thrown: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Request method failure captured: Apr 20 18:51:00 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 HTTP/1.1 Apr 20 18:51:00 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:51:00 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:51:00 user devstack@n-api.service[61666]: Connection: close Apr 20 18:51:00 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:51:00 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:51:00 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:51:00 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:51:00 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhFeVBrtv8-q_wcBlELmBaDNy-dhMo_dIwFyuiiKuGXTEDWm3WoDtMp2XbwITyBe7fq1lEV9xLWLCJ-fNdnH_NV_52wQTcnPppJZme3UfIaDBaFT91xgT3tNzSRV4ZzcoUf0HiMhw7OqgrVEL8CKag9CQaCaZYEZ69bIGCGpwZ3UkE Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Project-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}] Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Tenant-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:00 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:00 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:00 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:51:00 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:51:00 user devstack@n-api.service[61666]: X-User-Id: 10dd79d3683e4780b76f0f2d9b6aefae Apr 20 18:51:00 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:00 user devstack@n-api.service[61666]: method: > Apr 20 18:51:00 user devstack@n-api.service[61666]: exception: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61666]: action_args: {'id': '92bb6d66-5883-449a-9bd1-8668a7877237'} Apr 20 18:51:00 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Returning 404 to user: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:00 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-51ab8a81-4b56-4225-b138-8afd20b1210c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 404 len: 111 microversion: 2.1 time: 0.127561 Apr 20 18:51:00 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 92/279] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:00 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:00 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-0b62b855-fe9d-42c8-9545-7f72d3697a32 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '.version_select at 0x7fe63eb92ef0>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:00 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-0b62b855-fe9d-42c8-9545-7f72d3697a32 tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-438564443" status: 202 len: 0 microversion: 2.1 time: 0.039423 Apr 20 18:51:00 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 95/280] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:51:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-438564443 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=11 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] [instance: 873ed527-b7b4-49d3-96b9-2268663c39b9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:00 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] HTTP exception thrown: Instance 873ed527-b7b4-49d3-96b9-2268663c39b9 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Request method failure captured: Apr 20 18:51:00 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9 HTTP/1.1 Apr 20 18:51:00 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:51:00 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:51:00 user devstack@n-api.service[61668]: Connection: close Apr 20 18:51:00 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:51:00 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:51:00 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:51:00 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:51:00 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgKBqxyunZhmEuF1_hLdGKHfogWx03PkPx6EyQAzmF2wWQpe2vqNPZ7XM4OEQvc7wcDjo4BbElgLcNjuDgactg9HOj2kN0uF9UWoeEbixeqWJDl9xW42eRqXeuYaJq-cqkcNYceW7rUP2BdYDA2gHb3R5oF8I5_T821W2hZybAZikk Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Project-Id: 641b4a94c3114312ae2f8b3658921374 Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1808078690 Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/641b4a94c3114312ae2f8b3658921374"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/641b4a94c3114312ae2f8b3658921374"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/641b4a94c3114312ae2f8b3658921374"}]}] Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1808078690 Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Tenant-Id: 641b4a94c3114312ae2f8b3658921374 Apr 20 18:51:00 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1808078690 Apr 20 18:51:00 user devstack@n-api.service[61668]: X-User: tempest-ServerRescueNegativeTestJSON-1808078690-project-member Apr 20 18:51:00 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:51:00 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:51:00 user devstack@n-api.service[61668]: X-User-Id: e33a2234ce2640f59dbf4dc4e693b0af Apr 20 18:51:00 user devstack@n-api.service[61668]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1808078690-project-member Apr 20 18:51:00 user devstack@n-api.service[61668]: method: > Apr 20 18:51:00 user devstack@n-api.service[61668]: exception: Instance 873ed527-b7b4-49d3-96b9-2268663c39b9 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61668]: action_args: {'id': '873ed527-b7b4-49d3-96b9-2268663c39b9'} Apr 20 18:51:00 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873ed527-b7b4-49d3-96b9-2268663c39b9 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873ed527-b7b4-49d3-96b9-2268663c39b9 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873ed527-b7b4-49d3-96b9-2268663c39b9 could not be found. Apr 20 18:51:00 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:00 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] Returning 404 to user: Instance 873ed527-b7b4-49d3-96b9-2268663c39b9 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:00 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-c62c594a-32e5-4e55-ae21-494bf70cc817 tempest-ServerRescueNegativeTestJSON-1808078690 tempest-ServerRescueNegativeTestJSON-1808078690-project-member] 10.0.0.210 "GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9" status: 404 len: 111 microversion: 2.1 time: 0.044130 Apr 20 18:51:00 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 94/281] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:00 2023] GET /compute/v2.1/servers/873ed527-b7b4-49d3-96b9-2268663c39b9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:01 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] HTTP exception thrown: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Request method failure captured: Apr 20 18:51:01 user devstack@n-api.service[61666]: request: DELETE /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 HTTP/1.1 Apr 20 18:51:01 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:51:01 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:51:01 user devstack@n-api.service[61666]: Connection: close Apr 20 18:51:01 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:51:01 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:51:01 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:51:01 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:51:01 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhFeVBrtv8-q_wcBlELmBaDNy-dhMo_dIwFyuiiKuGXTEDWm3WoDtMp2XbwITyBe7fq1lEV9xLWLCJ-fNdnH_NV_52wQTcnPppJZme3UfIaDBaFT91xgT3tNzSRV4ZzcoUf0HiMhw7OqgrVEL8CKag9CQaCaZYEZ69bIGCGpwZ3UkE Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Project-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}] Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Tenant-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:01 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:01 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:01 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:51:01 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:51:01 user devstack@n-api.service[61666]: X-User-Id: 10dd79d3683e4780b76f0f2d9b6aefae Apr 20 18:51:01 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:01 user devstack@n-api.service[61666]: method: > Apr 20 18:51:01 user devstack@n-api.service[61666]: exception: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61666]: action_args: {'id': '92bb6d66-5883-449a-9bd1-8668a7877237'} Apr 20 18:51:01 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Returning 404 to user: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:01 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-1652d561-6b1e-49a8-8518-e305f3e0529e tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 404 len: 111 microversion: 2.1 time: 0.026519 Apr 20 18:51:01 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:51:01 2023] DELETE /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: 92bb6d66-5883-449a-9bd1-8668a7877237] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:01 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] HTTP exception thrown: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Request method failure captured: Apr 20 18:51:01 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 HTTP/1.1 Apr 20 18:51:01 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:51:01 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:51:01 user devstack@n-api.service[61667]: Connection: close Apr 20 18:51:01 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:51:01 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:51:01 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:51:01 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:51:01 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYhFeVBrtv8-q_wcBlELmBaDNy-dhMo_dIwFyuiiKuGXTEDWm3WoDtMp2XbwITyBe7fq1lEV9xLWLCJ-fNdnH_NV_52wQTcnPppJZme3UfIaDBaFT91xgT3tNzSRV4ZzcoUf0HiMhw7OqgrVEL8CKag9CQaCaZYEZ69bIGCGpwZ3UkE Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Project-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Project-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}] Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Tenant: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Tenant-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:01 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:01 user devstack@n-api.service[61667]: X-User: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:01 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:51:01 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:51:01 user devstack@n-api.service[61667]: X-User-Id: 10dd79d3683e4780b76f0f2d9b6aefae Apr 20 18:51:01 user devstack@n-api.service[61667]: X-User-Name: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:01 user devstack@n-api.service[61667]: method: > Apr 20 18:51:01 user devstack@n-api.service[61667]: exception: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61667]: action_args: {'id': '92bb6d66-5883-449a-9bd1-8668a7877237'} Apr 20 18:51:01 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. Apr 20 18:51:01 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:01 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Returning 404 to user: Instance 92bb6d66-5883-449a-9bd1-8668a7877237 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:01 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-66655a87-563f-4194-8dbb-28f0d335977d tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237" status: 404 len: 111 microversion: 2.1 time: 0.035493 Apr 20 18:51:01 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 96/283] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:01 2023] GET /compute/v2.1/servers/92bb6d66-5883-449a-9bd1-8668a7877237 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] HTTP exception thrown: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Request method failure captured: Apr 20 18:51:02 user devstack@n-api.service[61668]: request: DELETE /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 HTTP/1.1 Apr 20 18:51:02 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:51:02 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:51:02 user devstack@n-api.service[61668]: Connection: close Apr 20 18:51:02 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:51:02 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:51:02 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:51:02 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:51:02 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYhFeVBrtv8-q_wcBlELmBaDNy-dhMo_dIwFyuiiKuGXTEDWm3WoDtMp2XbwITyBe7fq1lEV9xLWLCJ-fNdnH_NV_52wQTcnPppJZme3UfIaDBaFT91xgT3tNzSRV4ZzcoUf0HiMhw7OqgrVEL8CKag9CQaCaZYEZ69bIGCGpwZ3UkE Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Project-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}] Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Tenant-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:02 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:02 user devstack@n-api.service[61668]: X-User: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:02 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:51:02 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:51:02 user devstack@n-api.service[61668]: X-User-Id: 10dd79d3683e4780b76f0f2d9b6aefae Apr 20 18:51:02 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:02 user devstack@n-api.service[61668]: method: > Apr 20 18:51:02 user devstack@n-api.service[61668]: exception: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61668]: action_args: {'id': 'fca2bb9f-f489-4343-8d66-038fd5681bb9'} Apr 20 18:51:02 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Returning 404 to user: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-441f7bb0-2908-4273-9d21-d35a67270ceb tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 404 len: 111 microversion: 2.1 time: 0.027310 Apr 20 18:51:02 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 95/284] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:51:02 2023] DELETE /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] [instance: fca2bb9f-f489-4343-8d66-038fd5681bb9] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] HTTP exception thrown: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Request method failure captured: Apr 20 18:51:02 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 HTTP/1.1 Apr 20 18:51:02 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:51:02 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:51:02 user devstack@n-api.service[61666]: Connection: close Apr 20 18:51:02 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:51:02 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:51:02 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:51:02 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:51:02 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhFeVBrtv8-q_wcBlELmBaDNy-dhMo_dIwFyuiiKuGXTEDWm3WoDtMp2XbwITyBe7fq1lEV9xLWLCJ-fNdnH_NV_52wQTcnPppJZme3UfIaDBaFT91xgT3tNzSRV4ZzcoUf0HiMhw7OqgrVEL8CKag9CQaCaZYEZ69bIGCGpwZ3UkE Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Project-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9eebb7c6a8414543b3d9c5830fddb2c2"}]}] Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Tenant-Id: 9eebb7c6a8414543b3d9c5830fddb2c2 Apr 20 18:51:02 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-645647790 Apr 20 18:51:02 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:02 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:51:02 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:51:02 user devstack@n-api.service[61666]: X-User-Id: 10dd79d3683e4780b76f0f2d9b6aefae Apr 20 18:51:02 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeTestJSON-645647790-project-member Apr 20 18:51:02 user devstack@n-api.service[61666]: method: > Apr 20 18:51:02 user devstack@n-api.service[61666]: exception: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61666]: action_args: {'id': 'fca2bb9f-f489-4343-8d66-038fd5681bb9'} Apr 20 18:51:02 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. Apr 20 18:51:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:51:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] Returning 404 to user: Instance fca2bb9f-f489-4343-8d66-038fd5681bb9 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-1b590c1f-2836-49ef-8be1-106b9d88b44c tempest-AttachVolumeTestJSON-645647790 tempest-AttachVolumeTestJSON-645647790-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9" status: 404 len: 111 microversion: 2.1 time: 0.026348 Apr 20 18:51:02 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 94/285] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:02 2023] GET /compute/v2.1/servers/fca2bb9f-f489-4343-8d66-038fd5681bb9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:02 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:03 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:03 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-a267b79a-013c-4b3d-92ff-7987023afff3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 200 len: 1545 microversion: 2.1 time: 0.397521 Apr 20 18:51:03 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 97/286] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:02 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 1545 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:05 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:05 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-02788121-46d9-49a1-9b34-ee99295edd8a tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1494 microversion: 2.1 time: 0.237331 Apr 20 18:51:05 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 96/287] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:05 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1494 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:05 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f2721267-e42e-45c5-a8b0-0bc6aa03a7cc tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Action: 'create', calling method: .version_select at 0x7fe63e9835b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2080564223", "metadata": {"Type": "work"}}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:06 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f2721267-e42e-45c5-a8b0-0bc6aa03a7cc tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.578768 Apr 20 18:51:06 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 95/288] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 18:51:05 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 580 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 18:51:06 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-09b8ed94-c92f-4057-9f42-a4acd683c55e tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Calling method '.version_select at 0x7fe63eb93490>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:06 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-09b8ed94-c92f-4057-9f42-a4acd683c55e tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8" status: 200 len: 350 microversion: 2.1 time: 0.071597 Apr 20 18:51:06 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 98/289] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:51:06 2023] GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8 => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:07 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-5b9da1a5-d7eb-45ab-9a61-9bafc3bb6182 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Calling method '.version_select at 0x7fe63ea3eb90>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:07 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-5b9da1a5-d7eb-45ab-9a61-9bafc3bb6182 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8" status: 200 len: 350 microversion: 2.1 time: 0.073374 Apr 20 18:51:07 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 97/290] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:51:07 2023] GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:07 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-40b6940e-14c8-46b5-9923-fa9e9432b252 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Calling method '.version_select at 0x7fe63e981090>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:07 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-40b6940e-14c8-46b5-9923-fa9e9432b252 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8" status: 202 len: 0 microversion: 2.1 time: 0.113001 Apr 20 18:51:07 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 96/291] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:51:07 2023] DELETE /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:51:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-0de81938-dd7a-4b06-b9f1-6b74b2dfc0d6 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Calling method '.version_select at 0x7fe63eab5900>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:07 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-0de81938-dd7a-4b06-b9f1-6b74b2dfc0d6 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] HTTP exception thrown: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. Apr 20 18:51:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-0de81938-dd7a-4b06-b9f1-6b74b2dfc0d6 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Request method failure captured: Apr 20 18:51:07 user devstack@n-api.service[61667]: request: GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8 HTTP/1.1 Apr 20 18:51:07 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:51:07 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:51:07 user devstack@n-api.service[61667]: Connection: close Apr 20 18:51:07 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:51:07 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:51:07 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:51:07 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:51:07 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYmZIkm251C_RODmodaTlRSN1x0I4ABAyUD7zptu6aypCc8nkr9S96BpxmYgp9njoVhsG8ggs1P5iazgCQ7K-BqjzqgXJKKu2U3IomgFpXgJtjlNyOMUhft7UmL-L-zr_2HsNhyMtkRAIMiziIRDnHH9dRaQqJ-f9A_smEGCC_LxKIY Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Project-Id: 71fad26f29b24950927fdacd98d4886d Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Project-Name: tempest-VolumesGetTestJSON-1750323346 Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/71fad26f29b24950927fdacd98d4886d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71fad26f29b24950927fdacd98d4886d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/71fad26f29b24950927fdacd98d4886d"}]}] Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Tenant: tempest-VolumesGetTestJSON-1750323346 Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Tenant-Id: 71fad26f29b24950927fdacd98d4886d Apr 20 18:51:07 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-VolumesGetTestJSON-1750323346 Apr 20 18:51:07 user devstack@n-api.service[61667]: X-User: tempest-VolumesGetTestJSON-1750323346-project-member Apr 20 18:51:07 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:51:07 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:51:07 user devstack@n-api.service[61667]: X-User-Id: 196b76cf6e5a4f1da52e520d5e2f221a Apr 20 18:51:07 user devstack@n-api.service[61667]: X-User-Name: tempest-VolumesGetTestJSON-1750323346-project-member Apr 20 18:51:07 user devstack@n-api.service[61667]: method: Apr 20 18:51:07 user devstack@n-api.service[61667]: exception: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. Apr 20 18:51:07 user devstack@n-api.service[61667]: action_args: {'id': '329844b8-8f0d-4027-a42e-aa14a5b968a8'} Apr 20 18:51:07 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. (HTTP 404) (Request-ID: req-861a5f1f-64c4-405a-98e5-347e13019463) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. Apr 20 18:51:07 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:51:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-0de81938-dd7a-4b06-b9f1-6b74b2dfc0d6 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] Returning 404 to user: Volume 329844b8-8f0d-4027-a42e-aa14a5b968a8 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:51:07 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-0de81938-dd7a-4b06-b9f1-6b74b2dfc0d6 tempest-VolumesGetTestJSON-1750323346 tempest-VolumesGetTestJSON-1750323346-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8" status: 404 len: 109 microversion: 2.1 time: 0.041536 Apr 20 18:51:07 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 99/292] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:51:07 2023] GET /compute/v2.1/os-volumes/329844b8-8f0d-4027-a42e-aa14a5b968a8 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=10 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-554162467", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "networks": [{"uuid": "71d386db-e00e-4e26-8df1-4ad9de06dcbe"}]}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] validate_networks() for [('71d386db-e00e-4e26-8df1-4ad9de06dcbe', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Getting quotas for project 9e2ee247615a42fa9a38459d4766c118. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:51:21 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Getting quotas for user 59d430946d7644b3992e275749ff4d36 and project 9e2ee247615a42fa9a38459d4766c118. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:51:22 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:51:22 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:51:22 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-8fe2915d-f495-439b-9c16-57304f916f27 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.041767 Apr 20 18:51:22 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 98/293] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:51:21 2023] POST /compute/v2.1/servers => generated 378 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:51:22 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:22 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:22 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-fa3380ed-1c65-4a55-8ce8-8854ce206879 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:22 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-fa3380ed-1c65-4a55-8ce8-8854ce206879 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:22 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-fa3380ed-1c65-4a55-8ce8-8854ce206879 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d430946d7644b3992e275749ff4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2ee247615a42fa9a38459d4766c118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-fa3380ed-1c65-4a55-8ce8-8854ce206879 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f" status: 200 len: 1207 microversion: 2.1 time: 0.122723 Apr 20 18:51:22 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 97/294] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:22 2023] GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f => generated 1207 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=8 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:24 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-e8f07c05-ce88-49d2-93f1-9743b992f761 req-379f827f-7887-416b-9b7e-f3e03a82ff30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb02ff71-0a7b-4667-8a6c-520b3341e94f", "tag": "bf824979-cccf-4848-be49-0aa533391202"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e8f07c05-ce88-49d2-93f1-9743b992f761 req-379f827f-7887-416b-9b7e-f3e03a82ff30 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e8f07c05-ce88-49d2-93f1-9743b992f761 req-379f827f-7887-416b-9b7e-f3e03a82ff30 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e8f07c05-ce88-49d2-93f1-9743b992f761 req-379f827f-7887-416b-9b7e-f3e03a82ff30 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:24 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-e8f07c05-ce88-49d2-93f1-9743b992f761 req-379f827f-7887-416b-9b7e-f3e03a82ff30 service nova] Creating event network-changed:bf824979-cccf-4848-be49-0aa533391202 for instance eb02ff71-0a7b-4667-8a6c-520b3341e94f on user Apr 20 18:51:24 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-e8f07c05-ce88-49d2-93f1-9743b992f761 req-379f827f-7887-416b-9b7e-f3e03a82ff30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041332 Apr 20 18:51:24 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:51:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:27 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-d3405bb0-43f5-48fa-aefc-b76a8522940c req-4d8e189e-2c39-4549-ae44-da57ab67627f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02ff71-0a7b-4667-8a6c-520b3341e94f", "name": "network-vif-plugged", "status": "completed", "tag": "bf824979-cccf-4848-be49-0aa533391202"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3405bb0-43f5-48fa-aefc-b76a8522940c req-4d8e189e-2c39-4549-ae44-da57ab67627f service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3405bb0-43f5-48fa-aefc-b76a8522940c req-4d8e189e-2c39-4549-ae44-da57ab67627f service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3405bb0-43f5-48fa-aefc-b76a8522940c req-4d8e189e-2c39-4549-ae44-da57ab67627f service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:27 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-d3405bb0-43f5-48fa-aefc-b76a8522940c req-4d8e189e-2c39-4549-ae44-da57ab67627f service nova] Creating event network-vif-plugged:bf824979-cccf-4848-be49-0aa533391202 for instance eb02ff71-0a7b-4667-8a6c-520b3341e94f on user Apr 20 18:51:27 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-d3405bb0-43f5-48fa-aefc-b76a8522940c req-4d8e189e-2c39-4549-ae44-da57ab67627f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219932 Apr 20 18:51:27 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 99/296] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:29 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-b577b42b-e7c7-44b5-8af7-626c0703ad4d tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.393685 Apr 20 18:51:29 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 98/297] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:28 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:29 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-d3b56bef-d619-42f0-bce3-4b35d585e3f4 req-e3dea51d-4eb2-4231-ad46-caf4bd0d8809 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02ff71-0a7b-4667-8a6c-520b3341e94f", "name": "network-vif-plugged", "status": "completed", "tag": "bf824979-cccf-4848-be49-0aa533391202"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3b56bef-d619-42f0-bce3-4b35d585e3f4 req-e3dea51d-4eb2-4231-ad46-caf4bd0d8809 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3b56bef-d619-42f0-bce3-4b35d585e3f4 req-e3dea51d-4eb2-4231-ad46-caf4bd0d8809 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:29 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-d3b56bef-d619-42f0-bce3-4b35d585e3f4 req-e3dea51d-4eb2-4231-ad46-caf4bd0d8809 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:29 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-d3b56bef-d619-42f0-bce3-4b35d585e3f4 req-e3dea51d-4eb2-4231-ad46-caf4bd0d8809 service nova] Creating event network-vif-plugged:bf824979-cccf-4848-be49-0aa533391202 for instance eb02ff71-0a7b-4667-8a6c-520b3341e94f on user Apr 20 18:51:29 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-d3b56bef-d619-42f0-bce3-4b35d585e3f4 req-e3dea51d-4eb2-4231-ad46-caf4bd0d8809 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Apr 20 18:51:29 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 100/298] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:51:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:29 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:29 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-ee18dffd-2270-4c09-895d-d1d83c96629b tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.487216 Apr 20 18:51:29 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:29 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:30 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:30 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7dd150b1-1f64-4ef1-a326-e5732a26a759 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.340624 Apr 20 18:51:30 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 99/300] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:29 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:31 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:31 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-acb53c9c-4727-437f-9ae9-ab849ba8aeea tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 200 len: 1586 microversion: 2.20 time: 0.293229 Apr 20 18:51:31 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 101/301] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:51:31 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 1586 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:51:33 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-4ffcfef3-eb2a-4e9f-85ed-599c24271bb0 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Action: 'create', calling method: .version_select at 0x7fe63eab6d40>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1129406436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2I44n8xagbtDR07Zwv9tuKuDgVOjwv3VTUPnHRoaWappBFgPk4Wv1oFe3XUgnTq4pjKOCZi9FHgGcfkT2RFh3/lVDBrvMjnV4ja8uhWFWxoyICsCeg3tl5diTJI1Ec9A=="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:33 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-4ffcfef3-eb2a-4e9f-85ed-599c24271bb0 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:51:33 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-4ffcfef3-eb2a-4e9f-85ed-599c24271bb0 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for user b158eae659ca4ba2bb2672a295d37578 and project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:51:33 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-4ffcfef3-eb2a-4e9f-85ed-599c24271bb0 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059150 Apr 20 18:51:33 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 102/302] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:51:33 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:33 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-870752366", "imageRef": "d4daafe8-6a46-4a87-88e9-8cd861a522e3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1129406436", "networks": [{"uuid": "79c0a160-23e4-4df8-9284-c3e648a24ec3"}]}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:33 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:33 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] validate_networks() for [('79c0a160-23e4-4df8-9284-c3e648a24ec3', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1598843869"}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for user b158eae659ca4ba2bb2672a295d37578 and project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:51:34 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d4daafe8-6a46-4a87-88e9-8cd861a522e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:51:34 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-d8706494-4aca-4d59-b91b-852ff6852b33 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.639786 Apr 20 18:51:34 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 100/303] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:51:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:51:34 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-1874a768-9c55-4f87-a68f-5aba088d5b00 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:34 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-1874a768-9c55-4f87-a68f-5aba088d5b00 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:34 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1874a768-9c55-4f87-a68f-5aba088d5b00 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-1874a768-9c55-4f87-a68f-5aba088d5b00 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 200 len: 1252 microversion: 2.1 time: 0.097272 Apr 20 18:51:34 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 103/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:51:34 2023] GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 1252 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:51:35 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-2266d75e-c41d-4aa2-9d0f-25d4913d6e2b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93/action" status: 202 len: 52 microversion: 2.87 time: 1.170799 Apr 20 18:51:35 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 102/305] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 18:51:33 2023] POST /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93/action => generated 52 bytes in 1173 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 18:51:36 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-c7be4b59-02cf-4ba6-8661-c178aa1f1922 req-0922694b-588a-4149-8c8d-2bf589322fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760da168-8fa1-4d42-8531-7c5a7920fbb1", "tag": "9ea36b45-a7a1-4f8d-b177-50461406b00d"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:36 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c7be4b59-02cf-4ba6-8661-c178aa1f1922 req-0922694b-588a-4149-8c8d-2bf589322fe3 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:36 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c7be4b59-02cf-4ba6-8661-c178aa1f1922 req-0922694b-588a-4149-8c8d-2bf589322fe3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:36 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c7be4b59-02cf-4ba6-8661-c178aa1f1922 req-0922694b-588a-4149-8c8d-2bf589322fe3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:36 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-c7be4b59-02cf-4ba6-8661-c178aa1f1922 req-0922694b-588a-4149-8c8d-2bf589322fe3 service nova] Creating event network-changed:9ea36b45-a7a1-4f8d-b177-50461406b00d for instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 on user Apr 20 18:51:36 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-c7be4b59-02cf-4ba6-8661-c178aa1f1922 req-0922694b-588a-4149-8c8d-2bf589322fe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046688 Apr 20 18:51:36 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 101/306] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:51:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:39 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-12a35609-c271-4fe8-b7d8-0ccd66419ead req-2866169f-c953-4aa3-9d02-be85ab9e5eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760da168-8fa1-4d42-8531-7c5a7920fbb1", "name": "network-vif-plugged", "status": "completed", "tag": "9ea36b45-a7a1-4f8d-b177-50461406b00d"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:39 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-12a35609-c271-4fe8-b7d8-0ccd66419ead req-2866169f-c953-4aa3-9d02-be85ab9e5eb7 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:39 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-12a35609-c271-4fe8-b7d8-0ccd66419ead req-2866169f-c953-4aa3-9d02-be85ab9e5eb7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:39 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-12a35609-c271-4fe8-b7d8-0ccd66419ead req-2866169f-c953-4aa3-9d02-be85ab9e5eb7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:39 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-12a35609-c271-4fe8-b7d8-0ccd66419ead req-2866169f-c953-4aa3-9d02-be85ab9e5eb7 service nova] Creating event network-vif-plugged:9ea36b45-a7a1-4f8d-b177-50461406b00d for instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 on user Apr 20 18:51:39 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-12a35609-c271-4fe8-b7d8-0ccd66419ead req-2866169f-c953-4aa3-9d02-be85ab9e5eb7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076369 Apr 20 18:51:39 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 104/307] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:51:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:41 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-4562c315-0b5e-411f-aaa9-3b30bb1dfa9a req-5b918758-ec70-4648-8984-468ecab9fcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760da168-8fa1-4d42-8531-7c5a7920fbb1", "name": "network-vif-plugged", "status": "completed", "tag": "9ea36b45-a7a1-4f8d-b177-50461406b00d"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:51:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4562c315-0b5e-411f-aaa9-3b30bb1dfa9a req-5b918758-ec70-4648-8984-468ecab9fcf0 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4562c315-0b5e-411f-aaa9-3b30bb1dfa9a req-5b918758-ec70-4648-8984-468ecab9fcf0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:41 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-4562c315-0b5e-411f-aaa9-3b30bb1dfa9a req-5b918758-ec70-4648-8984-468ecab9fcf0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:51:41 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-4562c315-0b5e-411f-aaa9-3b30bb1dfa9a req-5b918758-ec70-4648-8984-468ecab9fcf0 service nova] Creating event network-vif-plugged:9ea36b45-a7a1-4f8d-b177-50461406b00d for instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 on user Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:41 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-4562c315-0b5e-411f-aaa9-3b30bb1dfa9a req-5b918758-ec70-4648-8984-468ecab9fcf0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038092 Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:41 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 103/308] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:51:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:41 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:51:41 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-a59c58a3-c777-49f2-ae9a-3f1b72d8381b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93" status: 200 len: 1688 microversion: 2.87 time: 0.253821 Apr 20 18:51:41 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 102/309] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:51:41 2023] GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 => generated 1688 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=10 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:03 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-f9b9a1dc-da6d-4035-a2a6-47594f803e34 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.178534 Apr 20 18:52:03 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 105/310] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 18:52:03 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f/os-interface => generated 283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:04 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-6035a14f-7ed2-4b14-89b7-c42c3a6ea52b req-98042d10-451e-4afa-aec2-26a7bf3792b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:04 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:04 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:04 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6035a14f-7ed2-4b14-89b7-c42c3a6ea52b req-98042d10-451e-4afa-aec2-26a7bf3792b7 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:04 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6035a14f-7ed2-4b14-89b7-c42c3a6ea52b req-98042d10-451e-4afa-aec2-26a7bf3792b7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:04 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6035a14f-7ed2-4b14-89b7-c42c3a6ea52b req-98042d10-451e-4afa-aec2-26a7bf3792b7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:04 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-6035a14f-7ed2-4b14-89b7-c42c3a6ea52b req-98042d10-451e-4afa-aec2-26a7bf3792b7 service nova] Creating event network-changed:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:52:04 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-6035a14f-7ed2-4b14-89b7-c42c3a6ea52b req-98042d10-451e-4afa-aec2-26a7bf3792b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048036 Apr 20 18:52:04 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 104/311] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=22 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:04 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:04 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-82f93f77-3708-4c3c-99de-42e8161568b3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f/ips" status: 200 len: 109 microversion: 2.1 time: 0.066813 Apr 20 18:52:04 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 103/312] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:52:04 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f/ips => generated 109 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:05 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:05 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-2cd1be98-a4d8-4e87-9fd9-db22973f9b2c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1494 microversion: 2.1 time: 0.237642 Apr 20 18:52:05 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 106/313] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:05 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1494 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:52:05 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:52:05 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-7806c40c-f629-43bc-9e74-0f78d310e9df tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 204 len: 0 microversion: 2.1 time: 0.112213 Apr 20 18:52:05 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:52:05 2023] DELETE /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:52:05 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:05 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:05 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:05 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:05 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:06 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:06 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c6275ba3d2249c7a04952e5726bb633', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8be777a9cd424d42ae9caae453cb2e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:06 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8d6cae53-a2ba-48c8-9f57-fb1c531b502c tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 200 len: 1669 microversion: 2.1 time: 0.320711 Apr 20 18:52:06 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 104/315] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:05 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 1669 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:52:06 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-46f9bb10-3489-43c5-87b9-e76df195d919 req-cdce7389-6873-497e-a1e1-cc21f7b406a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "name": "network-vif-unplugged", "status": "completed", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-46f9bb10-3489-43c5-87b9-e76df195d919 req-cdce7389-6873-497e-a1e1-cc21f7b406a8 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-46f9bb10-3489-43c5-87b9-e76df195d919 req-cdce7389-6873-497e-a1e1-cc21f7b406a8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:06 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-46f9bb10-3489-43c5-87b9-e76df195d919 req-cdce7389-6873-497e-a1e1-cc21f7b406a8 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:06 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-46f9bb10-3489-43c5-87b9-e76df195d919 req-cdce7389-6873-497e-a1e1-cc21f7b406a8 service nova] Creating event network-vif-unplugged:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:52:06 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-46f9bb10-3489-43c5-87b9-e76df195d919 req-cdce7389-6873-497e-a1e1-cc21f7b406a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033066 Apr 20 18:52:06 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 107/316] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:08 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "name": "network-vif-plugged", "status": "completed", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}, {"server_uuid": "f52bd46a-f649-43ba-9d13-d5f44f8a957f", "name": "network-vif-deleted", "tag": "af9a5871-5b03-4875-b4fc-388d8dad8d48"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] Creating event network-vif-plugged:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:52:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] Creating event network-vif-deleted:af9a5871-5b03-4875-b4fc-388d8dad8d48 for instance f52bd46a-f649-43ba-9d13-d5f44f8a957f on user Apr 20 18:52:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-879d5ac2-b271-4bdd-a78a-2ed5650462e5 req-bc772ac8-eb59-450b-9456-997502e5acff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030639 Apr 20 18:52:08 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:12 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d430946d7644b3992e275749ff4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2ee247615a42fa9a38459d4766c118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:12 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-abfa2c33-aad9-4d1b-961f-4a5d9f31c074 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f" status: 200 len: 1485 microversion: 2.1 time: 0.217340 Apr 20 18:52:12 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 105/318] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:12 2023] GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f => generated 1485 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=12 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:24 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:24 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-dedb053d-f4e4-4e18-b2d6-65f0be0ce2ce tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 200 len: 1535 microversion: 2.1 time: 0.219527 Apr 20 18:52:24 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 108/319] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:24 2023] GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 1535 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=16 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:32 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:32 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-33e691a8-d4f4-4cba-a7bc-7ce017399b38 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1656 microversion: 2.1 time: 0.229466 Apr 20 18:52:32 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 107/320] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:31 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1656 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:52:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-94164b08-d0ae-4c96-a291-c8c0aa402d00 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.163373 Apr 20 18:52:32 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 106/321] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 18:52:32 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:52:33 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-197ed5f4-ba68-447a-ac3d-6e0771f7c67a req-48354971-6270-4822-827d-b549c295caeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-197ed5f4-ba68-447a-ac3d-6e0771f7c67a req-48354971-6270-4822-827d-b549c295caeb service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-197ed5f4-ba68-447a-ac3d-6e0771f7c67a req-48354971-6270-4822-827d-b549c295caeb service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-197ed5f4-ba68-447a-ac3d-6e0771f7c67a req-48354971-6270-4822-827d-b549c295caeb service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:33 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-197ed5f4-ba68-447a-ac3d-6e0771f7c67a req-48354971-6270-4822-827d-b549c295caeb service nova] Creating event network-changed:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:33 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-197ed5f4-ba68-447a-ac3d-6e0771f7c67a req-48354971-6270-4822-827d-b549c295caeb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028304 Apr 20 18:52:33 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 109/322] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:34 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:34 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-29d1bfec-c400-40c7-9790-72c16f411f5b tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8/ips" status: 200 len: 148 microversion: 2.20 time: 0.034749 Apr 20 18:52:34 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 108/323] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 18:52:34 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8/ips => generated 148 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:35 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:52:35 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-57549d7b-b5b0-49fb-8dd6-62f01c5c7200 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 204 len: 0 microversion: 2.20 time: 0.108318 Apr 20 18:52:35 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 107/324] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:52:35 2023] DELETE /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:35 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:36 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:36 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:36 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:36 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-0d73e070-560f-416c-b267-94a522337a2d tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 200 len: 1710 microversion: 2.20 time: 0.269080 Apr 20 18:52:36 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 110/325] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:52:35 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 1710 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:52:36 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-038154f7-284d-47dc-9aa1-d9a3d20bb96b req-34d16623-6dbf-4448-a42e-25054f16253a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-unplugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:36 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-038154f7-284d-47dc-9aa1-d9a3d20bb96b req-34d16623-6dbf-4448-a42e-25054f16253a service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:36 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-038154f7-284d-47dc-9aa1-d9a3d20bb96b req-34d16623-6dbf-4448-a42e-25054f16253a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:36 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-038154f7-284d-47dc-9aa1-d9a3d20bb96b req-34d16623-6dbf-4448-a42e-25054f16253a service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:36 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-038154f7-284d-47dc-9aa1-d9a3d20bb96b req-34d16623-6dbf-4448-a42e-25054f16253a service nova] Creating event network-vif-unplugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:36 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-038154f7-284d-47dc-9aa1-d9a3d20bb96b req-34d16623-6dbf-4448-a42e-25054f16253a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039995 Apr 20 18:52:36 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:38 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-plugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}, {"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-plugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}, {"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-plugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}, {"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-deleted", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:38 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:38 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:38 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:38 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Creating event network-vif-plugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:38 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Creating event network-vif-plugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:38 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Creating event network-vif-plugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:38 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] Creating event network-vif-deleted:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:38 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-028f11ea-2f47-4ce0-97af-e4ced595aad6 req-2bf17593-49f3-48f4-8b1f-2324fc174056 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038088 Apr 20 18:52:38 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 108/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:38 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:40 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-5913b4f2-e73b-4dfd-b0a3-fd89daadfe3c req-0fc6f198-312a-42d0-9e69-1ba37ec4a303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c417042-c579-4e4b-b2fd-94a36e75baf8", "name": "network-vif-plugged", "status": "completed", "tag": "b64dc776-5f63-4961-a23c-2e449dcf74bc"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:40 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5913b4f2-e73b-4dfd-b0a3-fd89daadfe3c req-0fc6f198-312a-42d0-9e69-1ba37ec4a303 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:40 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5913b4f2-e73b-4dfd-b0a3-fd89daadfe3c req-0fc6f198-312a-42d0-9e69-1ba37ec4a303 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:40 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5913b4f2-e73b-4dfd-b0a3-fd89daadfe3c req-0fc6f198-312a-42d0-9e69-1ba37ec4a303 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:40 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-5913b4f2-e73b-4dfd-b0a3-fd89daadfe3c req-0fc6f198-312a-42d0-9e69-1ba37ec4a303 service nova] Creating event network-vif-plugged:b64dc776-5f63-4961-a23c-2e449dcf74bc for instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 on user Apr 20 18:52:40 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-5913b4f2-e73b-4dfd-b0a3-fd89daadfe3c req-0fc6f198-312a-42d0-9e69-1ba37ec4a303 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028559 Apr 20 18:52:40 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 111/328] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:41 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-130967016", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "destination_type": "volume"}], "networks": [{"uuid": "507056ae-4667-4837-80d1-49f642249cfa"}]}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:41 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] validate_networks() for [('507056ae-4667-4837-80d1-49f642249cfa', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Getting quotas for user 1332e51aa657411cb00f200b592c39f1 and project 455e6c598311404f90884c282f25c9bd. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:52:42 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:52:42 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-a9123632-79ca-40c0-a951-74732e1cf654 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.543944 Apr 20 18:52:42 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 110/329] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 18:52:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 18:52:42 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-c67a88eb-f25d-46af-8779-71f646c40d6d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:42 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-c67a88eb-f25d-46af-8779-71f646c40d6d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:42 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-c67a88eb-f25d-46af-8779-71f646c40d6d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:42 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-c67a88eb-f25d-46af-8779-71f646c40d6d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:42 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-c67a88eb-f25d-46af-8779-71f646c40d6d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:52:42 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-c67a88eb-f25d-46af-8779-71f646c40d6d tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb" status: 200 len: 1394 microversion: 2.87 time: 0.067998 Apr 20 18:52:42 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 109/330] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:52:42 2023] GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb => generated 1394 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:52:44 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-60bb9085-5032-4ce9-8ea8-419afebc5cb7 req-457de7ea-8f22-48b7-925f-4036abb0c1dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f84a1c-0cdb-448c-b434-0af0079d7eeb", "tag": "47941e5a-746e-4d4e-8ee5-94a5b5598729"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:44 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-60bb9085-5032-4ce9-8ea8-419afebc5cb7 req-457de7ea-8f22-48b7-925f-4036abb0c1dc service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:44 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-60bb9085-5032-4ce9-8ea8-419afebc5cb7 req-457de7ea-8f22-48b7-925f-4036abb0c1dc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:44 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-60bb9085-5032-4ce9-8ea8-419afebc5cb7 req-457de7ea-8f22-48b7-925f-4036abb0c1dc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:44 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-60bb9085-5032-4ce9-8ea8-419afebc5cb7 req-457de7ea-8f22-48b7-925f-4036abb0c1dc service nova] Creating event network-changed:47941e5a-746e-4d4e-8ee5-94a5b5598729 for instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb on user Apr 20 18:52:44 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-60bb9085-5032-4ce9-8ea8-419afebc5cb7 req-457de7ea-8f22-48b7-925f-4036abb0c1dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031265 Apr 20 18:52:44 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 112/331] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:52:46 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-f2e5c0d2-b332-4145-931d-977bf7c472a2 req-f8a3d49e-6a1c-46f7-a029-08d77ee84d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f84a1c-0cdb-448c-b434-0af0079d7eeb", "name": "network-vif-deleted", "tag": "47941e5a-746e-4d4e-8ee5-94a5b5598729"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:52:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-f2e5c0d2-b332-4145-931d-977bf7c472a2 req-f8a3d49e-6a1c-46f7-a029-08d77ee84d54 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-f2e5c0d2-b332-4145-931d-977bf7c472a2 req-f8a3d49e-6a1c-46f7-a029-08d77ee84d54 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:46 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-f2e5c0d2-b332-4145-931d-977bf7c472a2 req-f8a3d49e-6a1c-46f7-a029-08d77ee84d54 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:46 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.compute.server_external_events [req-f2e5c0d2-b332-4145-931d-977bf7c472a2 req-f8a3d49e-6a1c-46f7-a029-08d77ee84d54 service nova] Unable to find a host for instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb. Dropping event network-vif-deleted {{(pid=61668) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 18:52:46 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-f2e5c0d2-b332-4145-931d-977bf7c472a2 req-f8a3d49e-6a1c-46f7-a029-08d77ee84d54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026920 Apr 20 18:52:46 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 111/332] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:52:46 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:56 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:56 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f HTTP/1.1 Apr 20 18:52:56 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:52:56 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:52:56 user devstack@n-api.service[61666]: Connection: close Apr 20 18:52:56 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:52:56 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:52:56 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:52:56 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:52:56 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:56 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:52:56 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:52:56 user devstack@n-api.service[61666]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:56 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:56 user devstack@n-api.service[61666]: method: > Apr 20 18:52:56 user devstack@n-api.service[61666]: exception: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:56 user devstack@n-api.service[61666]: action_args: {'id': 'f52bd46a-f649-43ba-9d13-d5f44f8a957f'} Apr 20 18:52:56 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:56 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:56 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:56 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-43da7532-92fa-4dff-9086-37597e934915 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 404 len: 111 microversion: 2.1 time: 0.041898 Apr 20 18:52:56 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 110/333] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:56 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:52:56 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=10 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:56 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=18 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:56 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-155f0d3d-a7c7-46b2-be09-ab9b5cf99867 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '.version_select at 0x7fe63eab7b50>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:56 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-155f0d3d-a7c7-46b2-be09-ab9b5cf99867 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-225891191" status: 202 len: 0 microversion: 2.1 time: 0.031973 Apr 20 18:52:56 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 113/334] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:52:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-225891191 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=16 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:57 user devstack@n-api.service[61668]: request: DELETE /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f HTTP/1.1 Apr 20 18:52:57 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:52:57 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:52:57 user devstack@n-api.service[61668]: Connection: close Apr 20 18:52:57 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:52:57 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:52:57 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:52:57 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:52:57 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61668]: method: > Apr 20 18:52:57 user devstack@n-api.service[61668]: exception: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: action_args: {'id': 'f52bd46a-f649-43ba-9d13-d5f44f8a957f'} Apr 20 18:52:57 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-9c8391b2-0555-45a8-9e07-04393d542b56 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 404 len: 111 microversion: 2.1 time: 0.041400 Apr 20 18:52:57 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:52:57 2023] DELETE /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: f52bd46a-f649-43ba-9d13-d5f44f8a957f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:57 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f HTTP/1.1 Apr 20 18:52:57 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:52:57 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:52:57 user devstack@n-api.service[61666]: Connection: close Apr 20 18:52:57 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:52:57 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:52:57 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:52:57 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:52:57 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61666]: method: > Apr 20 18:52:57 user devstack@n-api.service[61666]: exception: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: action_args: {'id': 'f52bd46a-f649-43ba-9d13-d5f44f8a957f'} Apr 20 18:52:57 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance f52bd46a-f649-43ba-9d13-d5f44f8a957f could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-62a7c2f0-8f02-4b36-be9c-f8f3855d8ced tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f" status: 404 len: 111 microversion: 2.1 time: 0.029282 Apr 20 18:52:57 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 111/336] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:57 2023] GET /compute/v2.1/servers/f52bd46a-f649-43ba-9d13-d5f44f8a957f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:57 user devstack@n-api.service[61667]: request: DELETE /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 HTTP/1.1 Apr 20 18:52:57 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:52:57 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:52:57 user devstack@n-api.service[61667]: Connection: close Apr 20 18:52:57 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:52:57 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:52:57 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:52:57 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:52:57 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61667]: method: > Apr 20 18:52:57 user devstack@n-api.service[61667]: exception: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: action_args: {'id': 'cd303dc8-9628-437c-a220-109b96c258e9'} Apr 20 18:52:57 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:57 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-97d9afa1-1887-4955-ad99-2a8bdc95b1d1 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 404 len: 111 microversion: 2.1 time: 0.033664 Apr 20 18:52:57 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 114/337] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:52:57 2023] DELETE /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: cd303dc8-9628-437c-a220-109b96c258e9] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:57 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 HTTP/1.1 Apr 20 18:52:57 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:52:57 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:52:57 user devstack@n-api.service[61668]: Connection: close Apr 20 18:52:57 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:52:57 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:52:57 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:52:57 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:52:57 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:57 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61668]: method: > Apr 20 18:52:57 user devstack@n-api.service[61668]: exception: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: action_args: {'id': 'cd303dc8-9628-437c-a220-109b96c258e9'} Apr 20 18:52:57 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance cd303dc8-9628-437c-a220-109b96c258e9 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:57 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-6a92081c-6629-45f0-ad4d-109156be76f3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9" status: 404 len: 111 microversion: 2.1 time: 0.043578 Apr 20 18:52:57 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:57 2023] GET /compute/v2.1/servers/cd303dc8-9628-437c-a220-109b96c258e9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:57 user devstack@n-api.service[61666]: request: DELETE /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 HTTP/1.1 Apr 20 18:52:57 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:52:57 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:52:57 user devstack@n-api.service[61666]: Connection: close Apr 20 18:52:57 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:52:57 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:52:57 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:52:57 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:52:57 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:57 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61666]: method: > Apr 20 18:52:57 user devstack@n-api.service[61666]: exception: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: action_args: {'id': 'd56c0610-41b7-4083-9673-698c0acad654'} Apr 20 18:52:57 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:57 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7e9f9e26-4e5f-4041-b96a-05d105b0dfb3 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 404 len: 111 microversion: 2.1 time: 0.031159 Apr 20 18:52:57 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 112/339] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:52:57 2023] DELETE /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] [instance: d56c0610-41b7-4083-9673-698c0acad654] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:52:57 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] HTTP exception thrown: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Request method failure captured: Apr 20 18:52:57 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 HTTP/1.1 Apr 20 18:52:57 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:52:57 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:52:57 user devstack@n-api.service[61667]: Connection: close Apr 20 18:52:57 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:52:57 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:52:57 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:52:57 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:52:57 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYgJWi_hozCFY8PpcJrRu9reCifF2tFK8BSV2gVzA5xJR8gb5h6B-RH8jVrBfe4zTe4wKB6MChl61zv4y_igskCXM4eIhrI8D7QpzDG3TOfdJrHh-qLNs8jKAmH_0557h2PZG_aNcQNn1dr1J4YJN6GQc3yDdXOOn03clMX0WqpXGho Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Project-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8be777a9cd424d42ae9caae453cb2e52"}]}] Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Tenant: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Tenant-Id: 8be777a9cd424d42ae9caae453cb2e52 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-422913090 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Id: 2c6275ba3d2249c7a04952e5726bb633 Apr 20 18:52:57 user devstack@n-api.service[61667]: X-User-Name: tempest-AttachVolumeNegativeTest-422913090-project-member Apr 20 18:52:57 user devstack@n-api.service[61667]: method: > Apr 20 18:52:57 user devstack@n-api.service[61667]: exception: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: action_args: {'id': 'd56c0610-41b7-4083-9673-698c0acad654'} Apr 20 18:52:57 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. Apr 20 18:52:57 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:52:57 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] Returning 404 to user: Instance d56c0610-41b7-4083-9673-698c0acad654 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:52:57 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-6b3f730b-71dd-43ac-a3c9-85414f218ee0 tempest-AttachVolumeNegativeTest-422913090 tempest-AttachVolumeNegativeTest-422913090-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654" status: 404 len: 111 microversion: 2.1 time: 0.036262 Apr 20 18:52:57 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:52:57 2023] GET /compute/v2.1/servers/d56c0610-41b7-4083-9673-698c0acad654 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-472b1e88-0c8d-4b7a-ab0c-5a7986ecf0da tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Action: 'create', calling method: .version_select at 0x7fe63e907640>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1825030973", "metadata": {"Type": "work"}}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-472b1e88-0c8d-4b7a-ab0c-5a7986ecf0da tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Request method failure captured: Apr 20 18:53:02 user devstack@n-api.service[61668]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 18:53:02 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:53:02 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:53:02 user devstack@n-api.service[61668]: Connection: close Apr 20 18:53:02 user devstack@n-api.service[61668]: Content-Length: 122 Apr 20 18:53:02 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:53:02 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:53:02 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:53:02 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYoNFd6ncKtW6oyjN8RULtJnsUP1KK-HrqlZ0qg885BEkfWZnDjXLAo7ac5Ifn-rRUDUvuT_BQ6_EFJduyttFnkcT5EuFoixp5gEK-yJTepGsgURsQqMND_YSykiBa3oEsYLGodQwVHNw64PVjPgsIp5jra4t8waX-s0xZIUv1VGJbk Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}] Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Id: 3ca8843f767146cd95c6a201ebe44c9d Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Name: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61668]: Apr 20 18:53:02 user devstack@n-api.service[61668]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1825030973", "metadata": {"Type": "work"}}} Apr 20 18:53:02 user devstack@n-api.service[61668]: method: Apr 20 18:53:02 user devstack@n-api.service[61668]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61668]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1825030973', 'metadata': {'Type': 'work'}}}} Apr 20 18:53:02 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise error Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-472b1e88-0c8d-4b7a-ab0c-5a7986ecf0da tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-472b1e88-0c8d-4b7a-ab0c-5a7986ecf0da tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.226526 Apr 20 18:53:02 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 114/341] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 18:53:01 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 228 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-62825a1b-6e79-4d0c-9508-507bd6620cf8 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Action: 'create', calling method: .version_select at 0x7fe63e983be0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1868980842", "metadata": {"Type": "work"}}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-62825a1b-6e79-4d0c-9508-507bd6620cf8 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Request method failure captured: Apr 20 18:53:02 user devstack@n-api.service[61666]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 18:53:02 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:53:02 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:53:02 user devstack@n-api.service[61666]: Connection: close Apr 20 18:53:02 user devstack@n-api.service[61666]: Content-Length: 120 Apr 20 18:53:02 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:53:02 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:53:02 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:53:02 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYoNFd6ncKtW6oyjN8RULtJnsUP1KK-HrqlZ0qg885BEkfWZnDjXLAo7ac5Ifn-rRUDUvuT_BQ6_EFJduyttFnkcT5EuFoixp5gEK-yJTepGsgURsQqMND_YSykiBa3oEsYLGodQwVHNw64PVjPgsIp5jra4t8waX-s0xZIUv1VGJbk Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}] Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Tenant: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Tenant-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Id: 3ca8843f767146cd95c6a201ebe44c9d Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Name: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61666]: Apr 20 18:53:02 user devstack@n-api.service[61666]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1868980842", "metadata": {"Type": "work"}}} Apr 20 18:53:02 user devstack@n-api.service[61666]: method: Apr 20 18:53:02 user devstack@n-api.service[61666]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 18:53:02 user devstack@n-api.service[61666]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1868980842', 'metadata': {'Type': 'work'}}}} Apr 20 18:53:02 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise error Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi '0' Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-62825a1b-6e79-4d0c-9508-507bd6620cf8 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-62825a1b-6e79-4d0c-9508-507bd6620cf8 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009609 Apr 20 18:53:02 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 113/342] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 18:53:02 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-47eed4b5-d897-4253-8c6f-7d5499b5aea4 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Action: 'create', calling method: .version_select at 0x7fe63eab6c20>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1180243426", "metadata": {"Type": "work"}}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:02 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-47eed4b5-d897-4253-8c6f-7d5499b5aea4 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Request method failure captured: Apr 20 18:53:02 user devstack@n-api.service[61667]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 18:53:02 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:53:02 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:53:02 user devstack@n-api.service[61667]: Connection: close Apr 20 18:53:02 user devstack@n-api.service[61667]: Content-Length: 119 Apr 20 18:53:02 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:53:02 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:53:02 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:53:02 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYoNFd6ncKtW6oyjN8RULtJnsUP1KK-HrqlZ0qg885BEkfWZnDjXLAo7ac5Ifn-rRUDUvuT_BQ6_EFJduyttFnkcT5EuFoixp5gEK-yJTepGsgURsQqMND_YSykiBa3oEsYLGodQwVHNw64PVjPgsIp5jra4t8waX-s0xZIUv1VGJbk Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Project-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Project-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}] Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Tenant: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Tenant-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61667]: X-User: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61667]: X-User-Id: 3ca8843f767146cd95c6a201ebe44c9d Apr 20 18:53:02 user devstack@n-api.service[61667]: X-User-Name: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61667]: Apr 20 18:53:02 user devstack@n-api.service[61667]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1180243426", "metadata": {"Type": "work"}}} Apr 20 18:53:02 user devstack@n-api.service[61667]: method: Apr 20 18:53:02 user devstack@n-api.service[61667]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61667]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1180243426', 'metadata': {'Type': 'work'}}}} Apr 20 18:53:02 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise error Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi '' Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 18:53:02 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-47eed4b5-d897-4253-8c6f-7d5499b5aea4 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:02 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-47eed4b5-d897-4253-8c6f-7d5499b5aea4 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018190 Apr 20 18:53:02 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 116/343] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 18:53:02 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-afbd7b7a-0be9-445d-a91f-e625bd6e88fa tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Calling method '.version_select at 0x7fe63e91f400>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-afbd7b7a-0be9-445d-a91f-e625bd6e88fa tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] HTTP exception thrown: Volume tempest-invalid-1180989900 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-afbd7b7a-0be9-445d-a91f-e625bd6e88fa tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Request method failure captured: Apr 20 18:53:02 user devstack@n-api.service[61668]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1180989900 HTTP/1.1 Apr 20 18:53:02 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:53:02 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:53:02 user devstack@n-api.service[61668]: Connection: close Apr 20 18:53:02 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:53:02 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:53:02 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:53:02 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:53:02 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYoNFd6ncKtW6oyjN8RULtJnsUP1KK-HrqlZ0qg885BEkfWZnDjXLAo7ac5Ifn-rRUDUvuT_BQ6_EFJduyttFnkcT5EuFoixp5gEK-yJTepGsgURsQqMND_YSykiBa3oEsYLGodQwVHNw64PVjPgsIp5jra4t8waX-s0xZIUv1VGJbk Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}] Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Id: 3ca8843f767146cd95c6a201ebe44c9d Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Name: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61668]: method: Apr 20 18:53:02 user devstack@n-api.service[61668]: exception: Volume tempest-invalid-1180989900 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: action_args: {'id': 'tempest-invalid-1180989900'} Apr 20 18:53:02 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1180989900 could not be found. (HTTP 404) (Request-ID: req-14bf0c87-3632-459b-8bc2-201ed0c95524) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1180989900 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1180989900 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1180989900 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-afbd7b7a-0be9-445d-a91f-e625bd6e88fa tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Returning 404 to user: Volume tempest-invalid-1180989900 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-afbd7b7a-0be9-445d-a91f-e625bd6e88fa tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1180989900" status: 404 len: 99 microversion: 2.1 time: 0.045287 Apr 20 18:53:02 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 115/344] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:53:02 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1180989900 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7437f357-934f-49f0-85a1-1e8b9413902b tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003496 Apr 20 18:53:02 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 114/345] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 18:53:02 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-7d0917f4-31e4-499b-8baa-8beee6d33a52 tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006794 Apr 20 18:53:02 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 117/346] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 18:53:02 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d05abdf1-4545-42fc-ae09-d849ee3aa5ed tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Calling method '.version_select at 0x7fe63e91e320>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-d05abdf1-4545-42fc-ae09-d849ee3aa5ed tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] HTTP exception thrown: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d05abdf1-4545-42fc-ae09-d849ee3aa5ed tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Request method failure captured: Apr 20 18:53:02 user devstack@n-api.service[61668]: request: DELETE /compute/v2.1/os-volumes/c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 HTTP/1.1 Apr 20 18:53:02 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:53:02 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:53:02 user devstack@n-api.service[61668]: Connection: close Apr 20 18:53:02 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:53:02 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:53:02 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:53:02 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:53:02 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYoNFd6ncKtW6oyjN8RULtJnsUP1KK-HrqlZ0qg885BEkfWZnDjXLAo7ac5Ifn-rRUDUvuT_BQ6_EFJduyttFnkcT5EuFoixp5gEK-yJTepGsgURsQqMND_YSykiBa3oEsYLGodQwVHNw64PVjPgsIp5jra4t8waX-s0xZIUv1VGJbk Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Project-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}] Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Id: 3ca8843f767146cd95c6a201ebe44c9d Apr 20 18:53:02 user devstack@n-api.service[61668]: X-User-Name: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61668]: method: Apr 20 18:53:02 user devstack@n-api.service[61668]: exception: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: action_args: {'id': 'c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5'} Apr 20 18:53:02 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. (HTTP 404) (Request-ID: req-75080c16-e518-420c-bd38-b662d4a8ea30) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d05abdf1-4545-42fc-ae09-d849ee3aa5ed tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Returning 404 to user: Volume c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:02 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d05abdf1-4545-42fc-ae09-d849ee3aa5ed tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5" status: 404 len: 109 microversion: 2.1 time: 0.053212 Apr 20 18:53:02 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 116/347] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:53:02 2023] DELETE /compute/v2.1/os-volumes/c4c6ab22-ab5a-4a68-9c19-c93c4f23e3a5 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 18:53:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-4dcff33d-ef8f-49ed-bb56-fa064536113f tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Calling method '.version_select at 0x7fe640049510>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-4dcff33d-ef8f-49ed-bb56-fa064536113f tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] HTTP exception thrown: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-4dcff33d-ef8f-49ed-bb56-fa064536113f tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Request method failure captured: Apr 20 18:53:02 user devstack@n-api.service[61666]: request: GET /compute/v2.1/os-volumes/c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 HTTP/1.1 Apr 20 18:53:02 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:53:02 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:53:02 user devstack@n-api.service[61666]: Connection: close Apr 20 18:53:02 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:53:02 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:53:02 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:53:02 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:53:02 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYoNFd6ncKtW6oyjN8RULtJnsUP1KK-HrqlZ0qg885BEkfWZnDjXLAo7ac5Ifn-rRUDUvuT_BQ6_EFJduyttFnkcT5EuFoixp5gEK-yJTepGsgURsQqMND_YSykiBa3oEsYLGodQwVHNw64PVjPgsIp5jra4t8waX-s0xZIUv1VGJbk Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Project-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e1732d977a7a409099ec02742fd0554b"}]}] Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Tenant: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Tenant-Id: e1732d977a7a409099ec02742fd0554b Apr 20 18:53:02 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-VolumesNegativeTest-1097148355 Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Id: 3ca8843f767146cd95c6a201ebe44c9d Apr 20 18:53:02 user devstack@n-api.service[61666]: X-User-Name: tempest-VolumesNegativeTest-1097148355-project-member Apr 20 18:53:02 user devstack@n-api.service[61666]: method: Apr 20 18:53:02 user devstack@n-api.service[61666]: exception: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61666]: action_args: {'id': 'c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26'} Apr 20 18:53:02 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. (HTTP 404) (Request-ID: req-98761997-a4b8-4a22-9bc5-c71dadbb0f88) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. Apr 20 18:53:02 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-4dcff33d-ef8f-49ed-bb56-fa064536113f tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] Returning 404 to user: Volume c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:02 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-4dcff33d-ef8f-49ed-bb56-fa064536113f tempest-VolumesNegativeTest-1097148355 tempest-VolumesNegativeTest-1097148355-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26" status: 404 len: 109 microversion: 2.1 time: 0.039790 Apr 20 18:53:02 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 115/348] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:53:02 2023] GET /compute/v2.1/os-volumes/c6dc4b82-9a7f-473d-ac3f-54ce2bbd2d26 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:07 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:07 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-c444be8f-9aec-45ce-ac39-28722e05cd0c tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1494 microversion: 2.1 time: 0.488370 Apr 20 18:53:07 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 118/349] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:53:07 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1494 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:14 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:53:14 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-8c9accf2-7d0c-48d2-aa54-cf311692305a tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f" status: 204 len: 0 microversion: 2.1 time: 0.131566 Apr 20 18:53:14 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 117/350] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:53:14 2023] DELETE /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:14 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-21e5a316-e4ff-4dea-881e-961f24f5d1ea req-2169884a-38ac-4720-9322-daa0b7f84a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02ff71-0a7b-4667-8a6c-520b3341e94f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf824979-cccf-4848-be49-0aa533391202"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-21e5a316-e4ff-4dea-881e-961f24f5d1ea req-2169884a-38ac-4720-9322-daa0b7f84a39 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-21e5a316-e4ff-4dea-881e-961f24f5d1ea req-2169884a-38ac-4720-9322-daa0b7f84a39 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-21e5a316-e4ff-4dea-881e-961f24f5d1ea req-2169884a-38ac-4720-9322-daa0b7f84a39 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-21e5a316-e4ff-4dea-881e-961f24f5d1ea req-2169884a-38ac-4720-9322-daa0b7f84a39 service nova] Creating event network-vif-unplugged:bf824979-cccf-4848-be49-0aa533391202 for instance eb02ff71-0a7b-4667-8a6c-520b3341e94f on user Apr 20 18:53:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-21e5a316-e4ff-4dea-881e-961f24f5d1ea req-2169884a-38ac-4720-9322-daa0b7f84a39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038991 Apr 20 18:53:14 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 119/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:14 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d430946d7644b3992e275749ff4d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e2ee247615a42fa9a38459d4766c118', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:14 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-7583cf5f-14ca-449f-8632-3b224f352a49 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f" status: 200 len: 1491 microversion: 2.1 time: 0.264982 Apr 20 18:53:14 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 116/352] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:53:14 2023] GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f => generated 1491 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:53:15 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-8cedcf02-cfba-404a-93f9-d32e9e69ebde req-28598aec-2881-4619-ba5b-0691f3581079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02ff71-0a7b-4667-8a6c-520b3341e94f", "name": "network-vif-deleted", "tag": "bf824979-cccf-4848-be49-0aa533391202"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-8cedcf02-cfba-404a-93f9-d32e9e69ebde req-28598aec-2881-4619-ba5b-0691f3581079 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-8cedcf02-cfba-404a-93f9-d32e9e69ebde req-28598aec-2881-4619-ba5b-0691f3581079 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-8cedcf02-cfba-404a-93f9-d32e9e69ebde req-28598aec-2881-4619-ba5b-0691f3581079 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-8cedcf02-cfba-404a-93f9-d32e9e69ebde req-28598aec-2881-4619-ba5b-0691f3581079 service nova] Creating event network-vif-deleted:bf824979-cccf-4848-be49-0aa533391202 for instance eb02ff71-0a7b-4667-8a6c-520b3341e94f on user Apr 20 18:53:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-8cedcf02-cfba-404a-93f9-d32e9e69ebde req-28598aec-2881-4619-ba5b-0691f3581079 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041095 Apr 20 18:53:15 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 118/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:16 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-7c2f6fc2-9e58-4137-9451-d418ac01a1be req-e15a6020-61e9-4172-90b6-4dcb345a6e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02ff71-0a7b-4667-8a6c-520b3341e94f", "name": "network-vif-plugged", "status": "completed", "tag": "bf824979-cccf-4848-be49-0aa533391202"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-7c2f6fc2-9e58-4137-9451-d418ac01a1be req-e15a6020-61e9-4172-90b6-4dcb345a6e56 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-7c2f6fc2-9e58-4137-9451-d418ac01a1be req-e15a6020-61e9-4172-90b6-4dcb345a6e56 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:16 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-7c2f6fc2-9e58-4137-9451-d418ac01a1be req-e15a6020-61e9-4172-90b6-4dcb345a6e56 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:16 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-7c2f6fc2-9e58-4137-9451-d418ac01a1be req-e15a6020-61e9-4172-90b6-4dcb345a6e56 service nova] Creating event network-vif-plugged:bf824979-cccf-4848-be49-0aa533391202 for instance eb02ff71-0a7b-4667-8a6c-520b3341e94f on user Apr 20 18:53:16 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-7c2f6fc2-9e58-4137-9451-d418ac01a1be req-e15a6020-61e9-4172-90b6-4dcb345a6e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035717 Apr 20 18:53:16 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 120/354] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:24 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-159fe7fe-9dbb-4bff-a4a0-4870dc9b059d tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 200 len: 1535 microversion: 2.1 time: 0.211244 Apr 20 18:53:24 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 117/355] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:53:24 2023] GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 1535 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Searching by: {'deleted': False, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed'} {{(pid=61668) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:25 user devstack@n-api.service[61668]: DEBUG nova.compute.multi_cell_list [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61668) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 18:53:25 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-eb49540d-9dab-4e94-a3c0-3e824432edbd tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.185048 Apr 20 18:53:25 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 119/356] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 18:53:24 2023] GET /compute/v2.1/servers => generated 340 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:25 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:25 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-e940c2fd-f26a-4db3-a92d-d9bda6422a39 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 200 len: 1535 microversion: 2.1 time: 0.223899 Apr 20 18:53:25 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 121/357] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:53:25 2023] GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 1535 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] HTTP exception thrown: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Request method failure captured: Apr 20 18:53:26 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 HTTP/1.1 Apr 20 18:53:26 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:53:26 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:53:26 user devstack@n-api.service[61666]: Connection: close Apr 20 18:53:26 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:53:26 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:53:26 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:53:26 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:53:26 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYl-XhuIfV2gGwUio0Oe3UB-HaUbQIvrMmr3rV0caVHtfodeH08h0ZR_b5e2SP4vGX0VoE77vSlQwsSog3Ns-OwyVRPzbVLNdz-bFQswaO-fDHJXf477kXUv_SsXfw5QClMarYNwKHQcyB4yAf2RvfGvkHkUgSF9ulF4vOlWnYi7C3k Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Project-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27ae1955293e49b5a61280cee2084292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}] Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Tenant-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:53:26 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:53:26 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:53:26 user devstack@n-api.service[61666]: X-User-Id: 3f1d66bdeebc4100a788e4e8b81eacb8 Apr 20 18:53:26 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:53:26 user devstack@n-api.service[61666]: method: > Apr 20 18:53:26 user devstack@n-api.service[61666]: exception: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:53:26 user devstack@n-api.service[61666]: action_args: {'id': '0c417042-c579-4e4b-b2fd-94a36e75baf8'} Apr 20 18:53:26 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:53:26 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Returning 404 to user: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:26 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-a779d225-5b17-4ef4-813a-7c6cb476ca47 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 404 len: 111 microversion: 2.20 time: 0.026864 Apr 20 18:53:26 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 118/358] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:53:26 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:53:26 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-dcf0ad77-d981-4970-a6c4-0aeae8045781 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '.version_select at 0x7fe63e91f520>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:26 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-dcf0ad77-d981-4970-a6c4-0aeae8045781 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-530111901" status: 204 len: 0 microversion: 2.20 time: 0.032189 Apr 20 18:53:26 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 120/359] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 20 18:53:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-530111901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:53:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-f0aa14b5-d675-4eee-81bf-425756b590f6 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Action: 'create', calling method: .version_select at 0x7fe63eab6e60>, body: {"keypair": {"name": "tempest-keypair-1346840745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaxyYK1gYHLlHpY1zMu658VM7m6vvJWfV/ct83iq9jm36I3rq6Qscs+31d3PZJIFqPvq8WcL9kGRr3P8hBjscXiwySTNM0OT0mrlA8TpNo3lyD/xU96ShF+ZQmJ5w7Ocw=="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:26 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:26 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-f0aa14b5-d675-4eee-81bf-425756b590f6 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for project 27ae1955293e49b5a61280cee2084292. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:53:26 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-f0aa14b5-d675-4eee-81bf-425756b590f6 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for user 3f1d66bdeebc4100a788e4e8b81eacb8 and project 27ae1955293e49b5a61280cee2084292. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:53:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-f0aa14b5-d675-4eee-81bf-425756b590f6 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.056074 Apr 20 18:53:26 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 122/360] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 18:53:26 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:26 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:53:27 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-e5789fb4-661b-4e34-bfbd-33806f34e0ef tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 204 len: 0 microversion: 2.1 time: 0.113916 Apr 20 18:53:27 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 119/361] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:53:26 2023] DELETE /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:27 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:27 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-3bde81db-6bfa-4699-8817-87ebf66a5aa2 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 200 len: 1541 microversion: 2.1 time: 0.219563 Apr 20 18:53:27 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 121/362] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:53:27 2023] GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 1541 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 18:53:27 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-e1855d2f-d79e-4a0d-9a2d-33e6b8ef6fbb req-34fc87aa-ef44-40ca-8ade-2dffc0652cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760da168-8fa1-4d42-8531-7c5a7920fbb1", "name": "network-vif-unplugged", "status": "completed", "tag": "9ea36b45-a7a1-4f8d-b177-50461406b00d"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:27 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e1855d2f-d79e-4a0d-9a2d-33e6b8ef6fbb req-34fc87aa-ef44-40ca-8ade-2dffc0652cb0 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:27 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e1855d2f-d79e-4a0d-9a2d-33e6b8ef6fbb req-34fc87aa-ef44-40ca-8ade-2dffc0652cb0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:27 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-e1855d2f-d79e-4a0d-9a2d-33e6b8ef6fbb req-34fc87aa-ef44-40ca-8ade-2dffc0652cb0 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:27 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=21 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:53:27 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-e1855d2f-d79e-4a0d-9a2d-33e6b8ef6fbb req-34fc87aa-ef44-40ca-8ade-2dffc0652cb0 service nova] Creating event network-vif-unplugged:9ea36b45-a7a1-4f8d-b177-50461406b00d for instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 on user Apr 20 18:53:27 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-e1855d2f-d79e-4a0d-9a2d-33e6b8ef6fbb req-34fc87aa-ef44-40ca-8ade-2dffc0652cb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045614 Apr 20 18:53:27 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 123/363] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:28 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-456d43f8-97d3-490b-bc2d-5bb0c1610a20 req-55b3cf6c-1e28-417e-89e2-cbac4e7e137d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760da168-8fa1-4d42-8531-7c5a7920fbb1", "name": "network-vif-deleted", "tag": "9ea36b45-a7a1-4f8d-b177-50461406b00d"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-456d43f8-97d3-490b-bc2d-5bb0c1610a20 req-55b3cf6c-1e28-417e-89e2-cbac4e7e137d service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-456d43f8-97d3-490b-bc2d-5bb0c1610a20 req-55b3cf6c-1e28-417e-89e2-cbac4e7e137d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-456d43f8-97d3-490b-bc2d-5bb0c1610a20 req-55b3cf6c-1e28-417e-89e2-cbac4e7e137d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-456d43f8-97d3-490b-bc2d-5bb0c1610a20 req-55b3cf6c-1e28-417e-89e2-cbac4e7e137d service nova] Creating event network-vif-deleted:9ea36b45-a7a1-4f8d-b177-50461406b00d for instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 on user Apr 20 18:53:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-456d43f8-97d3-490b-bc2d-5bb0c1610a20 req-55b3cf6c-1e28-417e-89e2-cbac4e7e137d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028114 Apr 20 18:53:28 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 120/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-453672580", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0a0503d2-448c-47a3-b579-3c77d3872041"}], "security_groups": [{"name": "tempest-securitygroup--1939471825"}], "key_name": "tempest-keypair-1346840745", "user_data": "}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] validate_networks() for [('0a0503d2-448c-47a3-b579-3c77d3872041', None, None, None, None, None)] {{(pid=61668) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Flavor limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Image limits 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Flavor pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Image pref 0:0:0 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.virt.hardware [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61668) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for project 27ae1955293e49b5a61280cee2084292. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Getting quotas for user 3f1d66bdeebc4100a788e4e8b81eacb8 and project 27ae1955293e49b5a61280cee2084292. Resources: {'instances', 'ram', 'cores'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Going to run 1 instances... {{(pid=61668) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:53:28 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61668) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:53:28 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-4750ca26-1c42-4475-8aef-8fd456674fee tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.623198 Apr 20 18:53:28 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 122/365] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 18:53:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 18:53:29 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-12f5f9df-25f9-42df-88f6-b18c41b12134 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:29 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-12f5f9df-25f9-42df-88f6-b18c41b12134 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:29 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-12f5f9df-25f9-42df-88f6-b18c41b12134 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:29 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-12f5f9df-25f9-42df-88f6-b18c41b12134 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:29 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-12f5f9df-25f9-42df-88f6-b18c41b12134 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:29 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-12f5f9df-25f9-42df-88f6-b18c41b12134 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 200 len: 1275 microversion: 2.20 time: 0.067270 Apr 20 18:53:29 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 124/366] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:53:28 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 1275 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:53:29 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-5cf0a49c-9ca5-430c-8e68-054b3eac10db req-03334321-bd31-40d1-bb24-ecf77f33e545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760da168-8fa1-4d42-8531-7c5a7920fbb1", "name": "network-vif-plugged", "status": "completed", "tag": "9ea36b45-a7a1-4f8d-b177-50461406b00d"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-5cf0a49c-9ca5-430c-8e68-054b3eac10db req-03334321-bd31-40d1-bb24-ecf77f33e545 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-5cf0a49c-9ca5-430c-8e68-054b3eac10db req-03334321-bd31-40d1-bb24-ecf77f33e545 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:29 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-5cf0a49c-9ca5-430c-8e68-054b3eac10db req-03334321-bd31-40d1-bb24-ecf77f33e545 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:29 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-5cf0a49c-9ca5-430c-8e68-054b3eac10db req-03334321-bd31-40d1-bb24-ecf77f33e545 service nova] Creating event network-vif-plugged:9ea36b45-a7a1-4f8d-b177-50461406b00d for instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 on user Apr 20 18:53:29 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-5cf0a49c-9ca5-430c-8e68-054b3eac10db req-03334321-bd31-40d1-bb24-ecf77f33e545 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032787 Apr 20 18:53:29 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 121/367] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:31 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-84ff038a-47a0-4bf8-bfb4-6ba4881f9ccd req-f8cefb3b-8813-4a2a-9e90-d1b740b855c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-84ff038a-47a0-4bf8-bfb4-6ba4881f9ccd req-f8cefb3b-8813-4a2a-9e90-d1b740b855c5 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-84ff038a-47a0-4bf8-bfb4-6ba4881f9ccd req-f8cefb3b-8813-4a2a-9e90-d1b740b855c5 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:31 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-84ff038a-47a0-4bf8-bfb4-6ba4881f9ccd req-f8cefb3b-8813-4a2a-9e90-d1b740b855c5 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:31 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-84ff038a-47a0-4bf8-bfb4-6ba4881f9ccd req-f8cefb3b-8813-4a2a-9e90-d1b740b855c5 service nova] Creating event network-changed:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:53:31 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-84ff038a-47a0-4bf8-bfb4-6ba4881f9ccd req-f8cefb3b-8813-4a2a-9e90-d1b740b855c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Apr 20 18:53:31 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 123/368] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.objects.instance [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lazy-loading 'fault' on Instance uuid a1f84a1c-0cdb-448c-b434-0af0079d7eeb {{(pid=61667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:32 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-93b523ce-d340-4530-b20b-11b8766d6ae0 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb" status: 200 len: 1649 microversion: 2.87 time: 0.112639 Apr 20 18:53:32 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 125/369] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:53:32 2023] GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb => generated 1649 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Going to try to terminate instance {{(pid=61666) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:53:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-2b316028-50f7-4213-a151-91a9aa07b3a9 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 204 len: 0 microversion: 2.1 time: 0.123429 Apr 20 18:53:32 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 122/370] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:53:32 2023] DELETE /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Doing local delete in cell e570c5e4-d2bb-4eb5-ba69-c1c987d683f8(cell1) {{(pid=61668) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61668]: WARNING nova.compute.api [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] instance's host None is down, deleting from database Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] deallocate_for_instance() {{(pid=61668) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Instance cache missing network info. {{(pid=61668) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.network.neutron [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Updating instance_info_cache with network_info: [] {{(pid=61668) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 18:53:32 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61668) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 18:53:32 user devstack@n-api.service[61668]: WARNING nova.compute.api [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-6b4ec7b3-7f95-4432-90c9-b2bbddf07bc2 req-a6177429-8338-4c57-a1fd-af76fa21ab7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "name": "network-vif-unplugged", "status": "completed", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-6b4ec7b3-7f95-4432-90c9-b2bbddf07bc2 req-a6177429-8338-4c57-a1fd-af76fa21ab7d service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-6b4ec7b3-7f95-4432-90c9-b2bbddf07bc2 req-a6177429-8338-4c57-a1fd-af76fa21ab7d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:32 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-6b4ec7b3-7f95-4432-90c9-b2bbddf07bc2 req-a6177429-8338-4c57-a1fd-af76fa21ab7d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-6b4ec7b3-7f95-4432-90c9-b2bbddf07bc2 req-a6177429-8338-4c57-a1fd-af76fa21ab7d service nova] Creating event network-vif-unplugged:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:53:32 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-6b4ec7b3-7f95-4432-90c9-b2bbddf07bc2 req-a6177429-8338-4c57-a1fd-af76fa21ab7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034738 Apr 20 18:53:32 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 123/371] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:32 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '700556715e4440448e91a864a0086e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c72b0b62c9544459ab1fdac7a8938d13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:32 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-d2a9505b-ffcb-4e28-a2c4-2cca0dcccdce tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 200 len: 1662 microversion: 2.1 time: 0.315822 Apr 20 18:53:32 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 126/372] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:53:32 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 1662 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:53:33 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-87d6adb8-656b-4237-a594-be5dfc678467 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb" status: 204 len: 0 microversion: 2.87 time: 0.671981 Apr 20 18:53:33 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 124/373] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:53:32 2023] DELETE /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: a1f84a1c-0cdb-448c-b434-0af0079d7eeb] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:33 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] HTTP exception thrown: Instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb could not be found. Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Request method failure captured: Apr 20 18:53:33 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb HTTP/1.1 Apr 20 18:53:33 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:53:33 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:53:33 user devstack@n-api.service[61666]: Connection: close Apr 20 18:53:33 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:53:33 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:53:33 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:53:33 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:53:33 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhgtRIezK7bo8fL0O4MwlXym_N9uexdl5NNIrHv_yCUFgMBygqXb84uAIXnTc5SgF-tEvBvDnbF288ry4gLHZmI5P7Va7IfK4k7GX-d-YDy02SY1Uf6P8q3OGgTEFCJsEW0HEhxW45k5pXInKLVEn94CPziJ-8a3wpG1UKY7XwcJDg Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Project-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455e6c598311404f90884c282f25c9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}] Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Tenant-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:53:33 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:53:33 user devstack@n-api.service[61666]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:53:33 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:53:33 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:53:33 user devstack@n-api.service[61666]: X-User-Id: 1332e51aa657411cb00f200b592c39f1 Apr 20 18:53:33 user devstack@n-api.service[61666]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:53:33 user devstack@n-api.service[61666]: method: > Apr 20 18:53:33 user devstack@n-api.service[61666]: exception: Instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb could not be found. Apr 20 18:53:33 user devstack@n-api.service[61666]: action_args: {'id': 'a1f84a1c-0cdb-448c-b434-0af0079d7eeb'} Apr 20 18:53:33 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb could not be found. Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb could not be found. Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb could not be found. Apr 20 18:53:33 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:53:33 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Returning 404 to user: Instance a1f84a1c-0cdb-448c-b434-0af0079d7eeb could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:53:33 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-2c6fe924-4f6b-4314-8374-94e3c5a9aa0a tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb" status: 404 len: 111 microversion: 2.87 time: 0.027730 Apr 20 18:53:33 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 124/374] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:53:33 2023] GET /compute/v2.1/servers/a1f84a1c-0cdb-448c-b434-0af0079d7eeb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:33 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:53:33 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8e5faff5-9ef4-4466-9bc2-dff5e63ad2b1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93" status: 204 len: 0 microversion: 2.87 time: 0.271265 Apr 20 18:53:33 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 127/375] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:53:33 2023] DELETE /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:33 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:53:33 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-9f857875-d7f1-4aff-aee2-f0c8ca9cbe96 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93" status: 200 len: 1694 microversion: 2.87 time: 0.299004 Apr 20 18:53:33 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 125/376] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:53:33 2023] GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 => generated 1694 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:53:34 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-75890516-5d8e-480a-980d-95929208f443 req-653fa689-c129-4b7c-b745-f1f6e81045a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "name": "network-vif-deleted", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-75890516-5d8e-480a-980d-95929208f443 req-653fa689-c129-4b7c-b745-f1f6e81045a3 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-75890516-5d8e-480a-980d-95929208f443 req-653fa689-c129-4b7c-b745-f1f6e81045a3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:34 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-75890516-5d8e-480a-980d-95929208f443 req-653fa689-c129-4b7c-b745-f1f6e81045a3 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:34 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-75890516-5d8e-480a-980d-95929208f443 req-653fa689-c129-4b7c-b745-f1f6e81045a3 service nova] Creating event network-vif-deleted:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:53:34 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-75890516-5d8e-480a-980d-95929208f443 req-653fa689-c129-4b7c-b745-f1f6e81045a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041164 Apr 20 18:53:34 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 125/377] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:34 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72f6076-e158-4bd7-8b57-4641462e7d6c", "name": "network-vif-plugged", "status": "completed", "tag": "466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8"}, {"server_uuid": "0f0053eb-2b6f-46b5-8b72-cd9b1f322d93", "name": "network-vif-unplugged", "status": "completed", "tag": "9e44348e-22b8-4cfb-81a3-f952725f35f9"}, {"server_uuid": "0f0053eb-2b6f-46b5-8b72-cd9b1f322d93", "name": "network-vif-plugged", "status": "completed", "tag": "9e44348e-22b8-4cfb-81a3-f952725f35f9"}, {"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-plugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:34 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Creating event network-vif-plugged:466323a9-66dc-4b1c-b4cc-e8d8b9fe72a8 for instance a72f6076-e158-4bd7-8b57-4641462e7d6c on user Apr 20 18:53:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Creating event network-vif-unplugged:9e44348e-22b8-4cfb-81a3-f952725f35f9 for instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 on user Apr 20 18:53:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Creating event network-vif-plugged:9e44348e-22b8-4cfb-81a3-f952725f35f9 for instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 on user Apr 20 18:53:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] Creating event network-vif-plugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:53:34 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-1a3de4e0-b91c-48a8-bf62-790305a4c4e8 req-fe75156f-c07e-401a-b044-c23a48d13846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.052753 Apr 20 18:53:34 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 128/378] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:35 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-c5dd9f6c-86c8-408f-9309-bac661365e69 req-612ffff3-50e0-4020-99e7-963dc0af0f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0053eb-2b6f-46b5-8b72-cd9b1f322d93", "name": "network-vif-deleted", "tag": "9e44348e-22b8-4cfb-81a3-f952725f35f9"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:35 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c5dd9f6c-86c8-408f-9309-bac661365e69 req-612ffff3-50e0-4020-99e7-963dc0af0f69 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:35 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c5dd9f6c-86c8-408f-9309-bac661365e69 req-612ffff3-50e0-4020-99e7-963dc0af0f69 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:35 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c5dd9f6c-86c8-408f-9309-bac661365e69 req-612ffff3-50e0-4020-99e7-963dc0af0f69 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:35 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-c5dd9f6c-86c8-408f-9309-bac661365e69 req-612ffff3-50e0-4020-99e7-963dc0af0f69 service nova] Creating event network-vif-deleted:9e44348e-22b8-4cfb-81a3-f952725f35f9 for instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 on user Apr 20 18:53:35 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-c5dd9f6c-86c8-408f-9309-bac661365e69 req-612ffff3-50e0-4020-99e7-963dc0af0f69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Apr 20 18:53:35 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 126/379] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:53:36 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-623d60e7-15c4-482f-b423-cf548c6cb2ef req-f4b6e734-ce2b-4344-a322-7f6e5a8b6c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-plugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:53:36 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-623d60e7-15c4-482f-b423-cf548c6cb2ef req-f4b6e734-ce2b-4344-a322-7f6e5a8b6c09 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:53:36 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-623d60e7-15c4-482f-b423-cf548c6cb2ef req-f4b6e734-ce2b-4344-a322-7f6e5a8b6c09 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:53:36 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-623d60e7-15c4-482f-b423-cf548c6cb2ef req-f4b6e734-ce2b-4344-a322-7f6e5a8b6c09 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:53:36 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-623d60e7-15c4-482f-b423-cf548c6cb2ef req-f4b6e734-ce2b-4344-a322-7f6e5a8b6c09 service nova] Creating event network-vif-plugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:53:36 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-623d60e7-15c4-482f-b423-cf548c6cb2ef req-f4b6e734-ce2b-4344-a322-7f6e5a8b6c09 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029293 Apr 20 18:53:36 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 126/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:53:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] [instance: eb02ff71-0a7b-4667-8a6c-520b3341e94f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:04 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] HTTP exception thrown: Instance eb02ff71-0a7b-4667-8a6c-520b3341e94f could not be found. Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Request method failure captured: Apr 20 18:54:04 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f HTTP/1.1 Apr 20 18:54:04 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:54:04 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:54:04 user devstack@n-api.service[61667]: Connection: close Apr 20 18:54:04 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:54:04 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:54:04 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:54:04 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:54:04 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYmnWZqfNbdTne4NsXggwRe_Ixf9CR85BjMrcDtJIpRqajU97vEsmIlJg_s66ayEVES7eqBWD9HjfaIyDviWM4r3DZZkQ4qGZJ0UGMoMUiZ6C37BYQ_UCLtd5HvaghyNbs8lAIv1IdliiGk6M4OhCoJLB61wS-CdjIIfAXcgVJSbT-0 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Project-Id: 9e2ee247615a42fa9a38459d4766c118 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Project-Name: tempest-VolumesActionsTest-1834394120 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e2ee247615a42fa9a38459d4766c118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e2ee247615a42fa9a38459d4766c118"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e2ee247615a42fa9a38459d4766c118"}]}] Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Tenant: tempest-VolumesActionsTest-1834394120 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Tenant-Id: 9e2ee247615a42fa9a38459d4766c118 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-VolumesActionsTest-1834394120 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-User: tempest-VolumesActionsTest-1834394120-project-member Apr 20 18:54:04 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:54:04 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:54:04 user devstack@n-api.service[61667]: X-User-Id: 59d430946d7644b3992e275749ff4d36 Apr 20 18:54:04 user devstack@n-api.service[61667]: X-User-Name: tempest-VolumesActionsTest-1834394120-project-member Apr 20 18:54:04 user devstack@n-api.service[61667]: method: > Apr 20 18:54:04 user devstack@n-api.service[61667]: exception: Instance eb02ff71-0a7b-4667-8a6c-520b3341e94f could not be found. Apr 20 18:54:04 user devstack@n-api.service[61667]: action_args: {'id': 'eb02ff71-0a7b-4667-8a6c-520b3341e94f'} Apr 20 18:54:04 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb02ff71-0a7b-4667-8a6c-520b3341e94f could not be found. Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb02ff71-0a7b-4667-8a6c-520b3341e94f could not be found. Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb02ff71-0a7b-4667-8a6c-520b3341e94f could not be found. Apr 20 18:54:04 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:04 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] Returning 404 to user: Instance eb02ff71-0a7b-4667-8a6c-520b3341e94f could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:04 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-357f8604-98f0-408c-b13c-7feb00cc1bb7 tempest-VolumesActionsTest-1834394120 tempest-VolumesActionsTest-1834394120-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f" status: 404 len: 111 microversion: 2.1 time: 0.044121 Apr 20 18:54:04 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 129/381] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:04 2023] GET /compute/v2.1/servers/eb02ff71-0a7b-4667-8a6c-520b3341e94f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=6 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] HTTP exception thrown: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Request method failure captured: Apr 20 18:54:08 user devstack@n-api.service[61668]: request: DELETE /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 HTTP/1.1 Apr 20 18:54:08 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:54:08 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:54:08 user devstack@n-api.service[61668]: Connection: close Apr 20 18:54:08 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:54:08 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:54:08 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:54:08 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:54:08 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYhI9edPU5II-4d4mNWGxPmTqjtD8NnS2daJPgJy5-saoGWFv0D541uLwbwMSwJMgEJSyeCBNMmQ9Fl-EHS_b3BQHP_x5WEBQfrdlm2qqr8KPkR21Bd47WbBvyiF3wSDze65gb9mhC-VZE1VdJyF4w1eB8qlMooFMAcIIhVM_APN1FY Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Project-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Project-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33f79038404f4e02974038c4e127abc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}] Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Tenant: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Tenant-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:54:08 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:08 user devstack@n-api.service[61668]: X-User: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:54:08 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:54:08 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:54:08 user devstack@n-api.service[61668]: X-User-Id: 8809171383a24c6d9c5b6d7185b59f8f Apr 20 18:54:08 user devstack@n-api.service[61668]: X-User-Name: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:54:08 user devstack@n-api.service[61668]: method: > Apr 20 18:54:08 user devstack@n-api.service[61668]: exception: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61668]: action_args: {'id': '723ae2f4-e57d-4a56-8121-d27dc0e79869'} Apr 20 18:54:08 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Returning 404 to user: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-9d5295ab-7eab-45e6-8432-7ebf5a8e0dd1 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 404 len: 111 microversion: 2.1 time: 0.045585 Apr 20 18:54:08 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:54:08 2023] DELETE /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 723ae2f4-e57d-4a56-8121-d27dc0e79869] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] HTTP exception thrown: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Request method failure captured: Apr 20 18:54:08 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 HTTP/1.1 Apr 20 18:54:08 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:54:08 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:54:08 user devstack@n-api.service[61666]: Connection: close Apr 20 18:54:08 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:54:08 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:54:08 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:54:08 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:54:08 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhI9edPU5II-4d4mNWGxPmTqjtD8NnS2daJPgJy5-saoGWFv0D541uLwbwMSwJMgEJSyeCBNMmQ9Fl-EHS_b3BQHP_x5WEBQfrdlm2qqr8KPkR21Bd47WbBvyiF3wSDze65gb9mhC-VZE1VdJyF4w1eB8qlMooFMAcIIhVM_APN1FY Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Project-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Project-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33f79038404f4e02974038c4e127abc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}] Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Tenant: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Tenant-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:54:08 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:08 user devstack@n-api.service[61666]: X-User: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:54:08 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:54:08 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:54:08 user devstack@n-api.service[61666]: X-User-Id: 8809171383a24c6d9c5b6d7185b59f8f Apr 20 18:54:08 user devstack@n-api.service[61666]: X-User-Name: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:54:08 user devstack@n-api.service[61666]: method: > Apr 20 18:54:08 user devstack@n-api.service[61666]: exception: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61666]: action_args: {'id': '723ae2f4-e57d-4a56-8121-d27dc0e79869'} Apr 20 18:54:08 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. Apr 20 18:54:08 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Returning 404 to user: Instance 723ae2f4-e57d-4a56-8121-d27dc0e79869 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-338de0af-380e-4c3a-9259-c79a22fb28b0 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869" status: 404 len: 111 microversion: 2.1 time: 0.034891 Apr 20 18:54:08 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 127/383] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:08 2023] GET /compute/v2.1/servers/723ae2f4-e57d-4a56-8121-d27dc0e79869 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:54:08 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-4a2c08e4-6d7d-43a2-b9ed-27f16004c1fd tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 204 len: 0 microversion: 2.1 time: 0.127324 Apr 20 18:54:08 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 130/384] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:54:08 2023] DELETE /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-3f582439-050c-4938-90a2-aa9ee398c4e5 req-8786a554-913a-439a-a934-719788454c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9a1fc-a841-427c-90db-d910b4b21298", "name": "network-vif-unplugged", "status": "completed", "tag": "519b4cb2-1e2f-4a23-8186-cd9f0e423527"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-3f582439-050c-4938-90a2-aa9ee398c4e5 req-8786a554-913a-439a-a934-719788454c06 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-3f582439-050c-4938-90a2-aa9ee398c4e5 req-8786a554-913a-439a-a934-719788454c06 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:08 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-3f582439-050c-4938-90a2-aa9ee398c4e5 req-8786a554-913a-439a-a934-719788454c06 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:08 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8809171383a24c6d9c5b6d7185b59f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f79038404f4e02974038c4e127abc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-3f582439-050c-4938-90a2-aa9ee398c4e5 req-8786a554-913a-439a-a934-719788454c06 service nova] Creating event network-vif-unplugged:519b4cb2-1e2f-4a23-8186-cd9f0e423527 for instance 88a9a1fc-a841-427c-90db-d910b4b21298 on user Apr 20 18:54:08 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-c66664f5-3dc3-4088-8d6c-2681e02b4fac tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 200 len: 1500 microversion: 2.1 time: 0.279096 Apr 20 18:54:08 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 128/385] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:08 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 1500 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:54:08 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-3f582439-050c-4938-90a2-aa9ee398c4e5 req-8786a554-913a-439a-a934-719788454c06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035177 Apr 20 18:54:08 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 128/386] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:09 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-de8b32d7-a215-476b-9f8a-8fa60e37dad3 req-f866855f-cf43-4de9-8d8b-66aa85b11580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9a1fc-a841-427c-90db-d910b4b21298", "name": "network-vif-deleted", "tag": "519b4cb2-1e2f-4a23-8186-cd9f0e423527"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:09 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-de8b32d7-a215-476b-9f8a-8fa60e37dad3 req-f866855f-cf43-4de9-8d8b-66aa85b11580 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:09 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-de8b32d7-a215-476b-9f8a-8fa60e37dad3 req-f866855f-cf43-4de9-8d8b-66aa85b11580 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:09 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-de8b32d7-a215-476b-9f8a-8fa60e37dad3 req-f866855f-cf43-4de9-8d8b-66aa85b11580 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:09 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-de8b32d7-a215-476b-9f8a-8fa60e37dad3 req-f866855f-cf43-4de9-8d8b-66aa85b11580 service nova] Creating event network-vif-deleted:519b4cb2-1e2f-4a23-8186-cd9f0e423527 for instance 88a9a1fc-a841-427c-90db-d910b4b21298 on user Apr 20 18:54:09 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-de8b32d7-a215-476b-9f8a-8fa60e37dad3 req-f866855f-cf43-4de9-8d8b-66aa85b11580 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028988 Apr 20 18:54:09 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 131/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:10 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-c0ccdc1a-0d18-4e5d-81e7-12a779cd8c8a req-94738324-512f-499a-a4e5-62c00047e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a9a1fc-a841-427c-90db-d910b4b21298", "name": "network-vif-plugged", "status": "completed", "tag": "519b4cb2-1e2f-4a23-8186-cd9f0e423527"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c0ccdc1a-0d18-4e5d-81e7-12a779cd8c8a req-94738324-512f-499a-a4e5-62c00047e873 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c0ccdc1a-0d18-4e5d-81e7-12a779cd8c8a req-94738324-512f-499a-a4e5-62c00047e873 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:10 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-c0ccdc1a-0d18-4e5d-81e7-12a779cd8c8a req-94738324-512f-499a-a4e5-62c00047e873 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-c0ccdc1a-0d18-4e5d-81e7-12a779cd8c8a req-94738324-512f-499a-a4e5-62c00047e873 service nova] Creating event network-vif-plugged:519b4cb2-1e2f-4a23-8186-cd9f0e423527 for instance 88a9a1fc-a841-427c-90db-d910b4b21298 on user Apr 20 18:54:10 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-c0ccdc1a-0d18-4e5d-81e7-12a779cd8c8a req-94738324-512f-499a-a4e5-62c00047e873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035642 Apr 20 18:54:10 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: 760da168-8fa1-4d42-8531-7c5a7920fbb1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:17 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] HTTP exception thrown: Instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 could not be found. Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Request method failure captured: Apr 20 18:54:17 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 HTTP/1.1 Apr 20 18:54:17 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:54:17 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:54:17 user devstack@n-api.service[61666]: Connection: close Apr 20 18:54:17 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:54:17 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:54:17 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:54:17 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:54:17 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYmrethykD5zW7zWE47VOBlfhaq9vVysRIkVSodZsWD54gimwFJuuIsj44HDrMb1HIWh5G6OypQVKi-xXd2yLcCcfe796qLpcSQ0JXR2ptFADCnrCR8-VEP4ouKGKU6WMIvjGEzGE687UVAXOlKiepPWPG-HZq-ON_CFYPexA7R32uU Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Project-Id: 451697ad3ab142a4a6ce04b41fb589ed Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Project-Name: tempest-TestMinimumBasicScenario-1683785897 Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/451697ad3ab142a4a6ce04b41fb589ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/451697ad3ab142a4a6ce04b41fb589ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/451697ad3ab142a4a6ce04b41fb589ed"}]}] Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Tenant: tempest-TestMinimumBasicScenario-1683785897 Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Tenant-Id: 451697ad3ab142a4a6ce04b41fb589ed Apr 20 18:54:17 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1683785897 Apr 20 18:54:17 user devstack@n-api.service[61666]: X-User: tempest-TestMinimumBasicScenario-1683785897-project-member Apr 20 18:54:17 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:54:17 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:54:17 user devstack@n-api.service[61666]: X-User-Id: b158eae659ca4ba2bb2672a295d37578 Apr 20 18:54:17 user devstack@n-api.service[61666]: X-User-Name: tempest-TestMinimumBasicScenario-1683785897-project-member Apr 20 18:54:17 user devstack@n-api.service[61666]: method: > Apr 20 18:54:17 user devstack@n-api.service[61666]: exception: Instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 could not be found. Apr 20 18:54:17 user devstack@n-api.service[61666]: action_args: {'id': '760da168-8fa1-4d42-8531-7c5a7920fbb1'} Apr 20 18:54:17 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 could not be found. Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 could not be found. Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 could not be found. Apr 20 18:54:17 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:17 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Returning 404 to user: Instance 760da168-8fa1-4d42-8531-7c5a7920fbb1 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:17 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-e7c018f4-111d-4945-988a-db6785084d80 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1" status: 404 len: 111 microversion: 2.1 time: 0.031205 Apr 20 18:54:17 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:17 2023] GET /compute/v2.1/servers/760da168-8fa1-4d42-8531-7c5a7920fbb1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:54:17 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-17aafe9f-4af3-4792-87aa-e3fb1d0f1c1c tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '.version_select at 0x7fe63eab6560>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:17 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-17aafe9f-4af3-4792-87aa-e3fb1d0f1c1c tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1129406436" status: 202 len: 0 microversion: 2.1 time: 0.024030 Apr 20 18:54:17 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 132/390] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 18:54:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1129406436 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:19 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-b77e33fb-77c0-47ab-a288-e905f6325fd4 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 200 len: 1587 microversion: 2.20 time: 0.343861 Apr 20 18:54:19 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 130/391] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:54:19 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 1587 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:54:19 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-8753f427-4f74-4e97-a252-2549478f1325 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Action: 'create', calling method: .version_select at 0x7fe63e982050>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1115122990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkFfqK3Jo9wY8TO3e+N3WZ9AlDTCZPe1/wD6fXx42fjsGLHoykxx0kRzLzrVDBE+OM/F7tZF8BEEC0a81Fv3+0ZFC/XlEcRYxQb6TlkeBXER/WxsKtRql0fQ3bXctVeuQ=="}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:19 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-8753f427-4f74-4e97-a252-2549478f1325 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:54:19 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-8753f427-4f74-4e97-a252-2549478f1325 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for user b158eae659ca4ba2bb2672a295d37578 and project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'key_pairs'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:54:19 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-8753f427-4f74-4e97-a252-2549478f1325 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052511 Apr 20 18:54:19 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 130/392] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:54:19 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:19 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:19 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1009799526", "imageRef": "92542330-5390-4996-ab97-5ba084a50000", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1115122990", "networks": [{"uuid": "79c0a160-23e4-4df8-9284-c3e648a24ec3"}]}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:19 user devstack@n-api.service[61667]: DEBUG nova.network.neutron [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] validate_networks() for [('79c0a160-23e4-4df8-9284-c3e648a24ec3', None, None, None, None, None)] {{(pid=61667) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Flavor limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Image limits 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Flavor pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Image pref 0:0:0 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.virt.hardware [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Getting quotas for user b158eae659ca4ba2bb2672a295d37578 and project 451697ad3ab142a4a6ce04b41fb589ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Going to run 1 instances... {{(pid=61667) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:54:20 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92542330-5390-4996-ab97-5ba084a50000',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:54:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-bf864d90-9e28-4378-950d-8f77db1ce1b3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.649971 Apr 20 18:54:20 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 133/393] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:54:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:54:20 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-08023da8-20d6-4d24-af1d-38630820ed56 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:20 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-08023da8-20d6-4d24-af1d-38630820ed56 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:20 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-08023da8-20d6-4d24-af1d-38630820ed56 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:20 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-08023da8-20d6-4d24-af1d-38630820ed56 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 200 len: 1253 microversion: 2.1 time: 0.069381 Apr 20 18:54:20 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 131/394] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:20 2023] GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 1253 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:54:22 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-80616d64-0415-409d-a84f-f10ab580cc22 req-85f8a686-400d-4387-a8f0-19cf5bbaad97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-80616d64-0415-409d-a84f-f10ab580cc22 req-85f8a686-400d-4387-a8f0-19cf5bbaad97 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-80616d64-0415-409d-a84f-f10ab580cc22 req-85f8a686-400d-4387-a8f0-19cf5bbaad97 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-80616d64-0415-409d-a84f-f10ab580cc22 req-85f8a686-400d-4387-a8f0-19cf5bbaad97 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-80616d64-0415-409d-a84f-f10ab580cc22 req-85f8a686-400d-4387-a8f0-19cf5bbaad97 service nova] Creating event network-changed:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:54:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-80616d64-0415-409d-a84f-f10ab580cc22 req-85f8a686-400d-4387-a8f0-19cf5bbaad97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031488 Apr 20 18:54:22 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 131/395] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] [instance: a72f6076-e158-4bd7-8b57-4641462e7d6c] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:22 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] HTTP exception thrown: Instance a72f6076-e158-4bd7-8b57-4641462e7d6c could not be found. Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Request method failure captured: Apr 20 18:54:22 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c HTTP/1.1 Apr 20 18:54:22 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:54:22 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:54:22 user devstack@n-api.service[61667]: Connection: close Apr 20 18:54:22 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:54:22 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:54:22 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:54:22 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:54:22 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYgOjFYXw6Fm-z3JhbszZqPyNFgDFBck7ucaw0ZRzoXHbCk1Yxhvw9fROY5jA1zY7egOUMpx_a57jS-yKd2lm0LeGWKBU4O-bM9zVgWi0OKOKM_Z5mBpCpEBMtPX1Cra81ZkWqN6TRB6Nmhrkms9DF9Gma7G4adwzJjBXhU9n0MlFNg Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Project-Id: c72b0b62c9544459ab1fdac7a8938d13 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Project-Name: tempest-ServerActionsTestJSON-135467400 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c72b0b62c9544459ab1fdac7a8938d13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72b0b62c9544459ab1fdac7a8938d13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c72b0b62c9544459ab1fdac7a8938d13"}]}] Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Tenant: tempest-ServerActionsTestJSON-135467400 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Tenant-Id: c72b0b62c9544459ab1fdac7a8938d13 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-ServerActionsTestJSON-135467400 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-User: tempest-ServerActionsTestJSON-135467400-project-member Apr 20 18:54:22 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:54:22 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:54:22 user devstack@n-api.service[61667]: X-User-Id: 700556715e4440448e91a864a0086e02 Apr 20 18:54:22 user devstack@n-api.service[61667]: X-User-Name: tempest-ServerActionsTestJSON-135467400-project-member Apr 20 18:54:22 user devstack@n-api.service[61667]: method: > Apr 20 18:54:22 user devstack@n-api.service[61667]: exception: Instance a72f6076-e158-4bd7-8b57-4641462e7d6c could not be found. Apr 20 18:54:22 user devstack@n-api.service[61667]: action_args: {'id': 'a72f6076-e158-4bd7-8b57-4641462e7d6c'} Apr 20 18:54:22 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72f6076-e158-4bd7-8b57-4641462e7d6c could not be found. Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72f6076-e158-4bd7-8b57-4641462e7d6c could not be found. Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72f6076-e158-4bd7-8b57-4641462e7d6c could not be found. Apr 20 18:54:22 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:22 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Returning 404 to user: Instance a72f6076-e158-4bd7-8b57-4641462e7d6c could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:22 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-45717038-9377-415a-8689-2bdcb965052a tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c" status: 404 len: 111 microversion: 2.1 time: 0.029017 Apr 20 18:54:22 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 134/396] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:22 2023] GET /compute/v2.1/servers/a72f6076-e158-4bd7-8b57-4641462e7d6c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:54:22 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-5a0bcc36-e5be-4ac5-afb1-d20e46ef25b7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] Calling method '.version_select at 0x7fe63e745bd0>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:23 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-5a0bcc36-e5be-4ac5-afb1-d20e46ef25b7 tempest-ServerActionsTestJSON-135467400 tempest-ServerActionsTestJSON-135467400-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-263672336" status: 202 len: 0 microversion: 2.1 time: 0.031607 Apr 20 18:54:23 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 132/397] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 18:54:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-263672336 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] HTTP exception thrown: Instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 could not be found. Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Request method failure captured: Apr 20 18:54:24 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 HTTP/1.1 Apr 20 18:54:24 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:54:24 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:54:24 user devstack@n-api.service[61666]: Connection: close Apr 20 18:54:24 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:54:24 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:54:24 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:54:24 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:54:24 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhgtRIezK7bo8fL0O4MwlXym_N9uexdl5NNIrHv_yCUFgMBygqXb84uAIXnTc5SgF-tEvBvDnbF288ry4gLHZmI5P7Va7IfK4k7GX-d-YDy02SY1Uf6P8q3OGgTEFCJsEW0HEhxW45k5pXInKLVEn94CPziJ-8a3wpG1UKY7XwcJDg Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Project-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455e6c598311404f90884c282f25c9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}] Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Tenant-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:54:24 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:54:24 user devstack@n-api.service[61666]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:54:24 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:54:24 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:54:24 user devstack@n-api.service[61666]: X-User-Id: 1332e51aa657411cb00f200b592c39f1 Apr 20 18:54:24 user devstack@n-api.service[61666]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:54:24 user devstack@n-api.service[61666]: method: > Apr 20 18:54:24 user devstack@n-api.service[61666]: exception: Instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 could not be found. Apr 20 18:54:24 user devstack@n-api.service[61666]: action_args: {'id': '0f0053eb-2b6f-46b5-8b72-cd9b1f322d93'} Apr 20 18:54:24 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 could not be found. Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 could not be found. Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 could not be found. Apr 20 18:54:24 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Returning 404 to user: Instance 0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-3279bfe6-aef7-4d02-85ca-63b4a31d66a1 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93" status: 404 len: 111 microversion: 2.87 time: 0.031956 Apr 20 18:54:24 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 132/398] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:54:24 2023] GET /compute/v2.1/servers/0f0053eb-2b6f-46b5-8b72-cd9b1f322d93 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:54:24 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-44dd15f8-279f-4f87-aa89-47b74a6e04c3 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1" status: 204 len: 0 microversion: 2.87 time: 0.111679 Apr 20 18:54:24 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 135/399] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:54:24 2023] DELETE /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:24 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1332e51aa657411cb00f200b592c39f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '455e6c598311404f90884c282f25c9bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:54:24 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-62739893-7911-445f-8056-08dc3dafe5a9 tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1" status: 200 len: 1696 microversion: 2.87 time: 0.313206 Apr 20 18:54:24 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 133/400] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:54:24 2023] GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 => generated 1696 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-2f51bb7c-f89c-452e-a904-6a14edafb6d0 req-0d951df0-3845-4a31-83d8-4217172cdb48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9a049b-d419-42e1-a458-41043de315f1", "name": "network-vif-unplugged", "status": "completed", "tag": "fee6cd42-2ec5-48bb-9239-9754d05828b8"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-2f51bb7c-f89c-452e-a904-6a14edafb6d0 req-0d951df0-3845-4a31-83d8-4217172cdb48 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-2f51bb7c-f89c-452e-a904-6a14edafb6d0 req-0d951df0-3845-4a31-83d8-4217172cdb48 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-2f51bb7c-f89c-452e-a904-6a14edafb6d0 req-0d951df0-3845-4a31-83d8-4217172cdb48 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-2f51bb7c-f89c-452e-a904-6a14edafb6d0 req-0d951df0-3845-4a31-83d8-4217172cdb48 service nova] Creating event network-vif-unplugged:fee6cd42-2ec5-48bb-9239-9754d05828b8 for instance 7f9a049b-d419-42e1-a458-41043de315f1 on user Apr 20 18:54:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-2f51bb7c-f89c-452e-a904-6a14edafb6d0 req-0d951df0-3845-4a31-83d8-4217172cdb48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038314 Apr 20 18:54:24 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 133/401] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:26 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-5f2e54db-427f-42bf-999b-b8ab41fabb20 req-2fb07dd9-f29c-4962-8661-579e17ea24d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-plugged", "status": "completed", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5f2e54db-427f-42bf-999b-b8ab41fabb20 req-2fb07dd9-f29c-4962-8661-579e17ea24d1 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5f2e54db-427f-42bf-999b-b8ab41fabb20 req-2fb07dd9-f29c-4962-8661-579e17ea24d1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:26 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-5f2e54db-427f-42bf-999b-b8ab41fabb20 req-2fb07dd9-f29c-4962-8661-579e17ea24d1 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-5f2e54db-427f-42bf-999b-b8ab41fabb20 req-2fb07dd9-f29c-4962-8661-579e17ea24d1 service nova] Creating event network-vif-plugged:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:54:26 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-5f2e54db-427f-42bf-999b-b8ab41fabb20 req-2fb07dd9-f29c-4962-8661-579e17ea24d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028979 Apr 20 18:54:26 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 136/402] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:26 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-6ca080f3-3fb1-4316-9d42-876108723c78 req-90d0e726-3b3d-4fce-b2ce-272287b8c2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f9a049b-d419-42e1-a458-41043de315f1", "name": "network-vif-plugged", "status": "completed", "tag": "fee6cd42-2ec5-48bb-9239-9754d05828b8"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6ca080f3-3fb1-4316-9d42-876108723c78 req-90d0e726-3b3d-4fce-b2ce-272287b8c2cc service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6ca080f3-3fb1-4316-9d42-876108723c78 req-90d0e726-3b3d-4fce-b2ce-272287b8c2cc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:26 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6ca080f3-3fb1-4316-9d42-876108723c78 req-90d0e726-3b3d-4fce-b2ce-272287b8c2cc service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:26 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-6ca080f3-3fb1-4316-9d42-876108723c78 req-90d0e726-3b3d-4fce-b2ce-272287b8c2cc service nova] Creating event network-vif-plugged:fee6cd42-2ec5-48bb-9239-9754d05828b8 for instance 7f9a049b-d419-42e1-a458-41043de315f1 on user Apr 20 18:54:26 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-6ca080f3-3fb1-4316-9d42-876108723c78 req-90d0e726-3b3d-4fce-b2ce-272287b8c2cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028517 Apr 20 18:54:26 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 134/403] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:28 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-plugged", "status": "completed", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}, {"server_uuid": "7f9a049b-d419-42e1-a458-41043de315f1", "name": "network-vif-deleted", "tag": "fee6cd42-2ec5-48bb-9239-9754d05828b8"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:54:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:28 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] Creating event network-vif-plugged:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:54:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] Creating event network-vif-deleted:fee6cd42-2ec5-48bb-9239-9754d05828b8 for instance 7f9a049b-d419-42e1-a458-41043de315f1 on user Apr 20 18:54:28 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-c4bd70da-7cdc-4b6f-b147-04b93e0e935e req-7d203b28-1d13-4448-9b4f-31beef32ca97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086797 Apr 20 18:54:28 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 134/404] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:54:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] [instance: 88a9a1fc-a841-427c-90db-d910b4b21298] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:54:58 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] HTTP exception thrown: Instance 88a9a1fc-a841-427c-90db-d910b4b21298 could not be found. Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Request method failure captured: Apr 20 18:54:58 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 HTTP/1.1 Apr 20 18:54:58 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:54:58 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:54:58 user devstack@n-api.service[61667]: Connection: close Apr 20 18:54:58 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:54:58 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:54:58 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:54:58 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:54:58 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYhI9edPU5II-4d4mNWGxPmTqjtD8NnS2daJPgJy5-saoGWFv0D541uLwbwMSwJMgEJSyeCBNMmQ9Fl-EHS_b3BQHP_x5WEBQfrdlm2qqr8KPkR21Bd47WbBvyiF3wSDze65gb9mhC-VZE1VdJyF4w1eB8qlMooFMAcIIhVM_APN1FY Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Project-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Project-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33f79038404f4e02974038c4e127abc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33f79038404f4e02974038c4e127abc6"}]}] Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Tenant: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Tenant-Id: 33f79038404f4e02974038c4e127abc6 Apr 20 18:54:58 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-ServersNegativeTestJSON-251859430 Apr 20 18:54:58 user devstack@n-api.service[61667]: X-User: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:54:58 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:54:58 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:54:58 user devstack@n-api.service[61667]: X-User-Id: 8809171383a24c6d9c5b6d7185b59f8f Apr 20 18:54:58 user devstack@n-api.service[61667]: X-User-Name: tempest-ServersNegativeTestJSON-251859430-project-member Apr 20 18:54:58 user devstack@n-api.service[61667]: method: > Apr 20 18:54:58 user devstack@n-api.service[61667]: exception: Instance 88a9a1fc-a841-427c-90db-d910b4b21298 could not be found. Apr 20 18:54:58 user devstack@n-api.service[61667]: action_args: {'id': '88a9a1fc-a841-427c-90db-d910b4b21298'} Apr 20 18:54:58 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88a9a1fc-a841-427c-90db-d910b4b21298 could not be found. Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88a9a1fc-a841-427c-90db-d910b4b21298 could not be found. Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88a9a1fc-a841-427c-90db-d910b4b21298 could not be found. Apr 20 18:54:58 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:54:58 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] Returning 404 to user: Instance 88a9a1fc-a841-427c-90db-d910b4b21298 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:54:58 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-db6cf9ff-f292-4653-9897-0efca52590c5 tempest-ServersNegativeTestJSON-251859430 tempest-ServersNegativeTestJSON-251859430-project-member] 10.0.0.210 "GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298" status: 404 len: 111 microversion: 2.1 time: 0.045482 Apr 20 18:54:58 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:54:58 2023] GET /compute/v2.1/servers/88a9a1fc-a841-427c-90db-d910b4b21298 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:55:00 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=2 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:00 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:00 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=24 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:01 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-9cee4321-bf2a-4f03-97a7-60d89744102f tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Action: 'create', calling method: .version_select at 0x7fe63e744d30>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1211787292", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMOem3LH9GqIFbnK0tGiqq6Ijq3KQM3RoXsLtcxpYhy/SW1UkyapZqnVcwvggctc2cZFw3/VPU6GxXCiZea1b9hlaet3vIyIt2br6//MZGTUxDxVGI526rdwfeFskoMig=="}} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:01 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-9cee4321-bf2a-4f03-97a7-60d89744102f tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Getting quotas for project 403b6ebfe1da4ec29a83f25db6cee5db. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:55:01 user devstack@n-api.service[61668]: DEBUG nova.quota [None req-9cee4321-bf2a-4f03-97a7-60d89744102f tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Getting quotas for user 2f969660d70f4543b930728e8a5f3db2 and project 403b6ebfe1da4ec29a83f25db6cee5db. Resources: {'key_pairs'} {{(pid=61668) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:55:01 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-9cee4321-bf2a-4f03-97a7-60d89744102f tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.205081 Apr 20 18:55:01 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 135/406] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:55:00 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:02 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=4 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:02 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:02 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=14 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:02 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1831457169", "imageRef": "aa98aa29-97c5-4e4c-b9d9-720fd5982785", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1211787292", "security_groups": [{"name": "tempest-secgroup-smoke-416595824"}], "networks": [{"uuid": "35c67dd6-0cd8-4c15-89ef-e2378e814739"}]}} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.network.neutron [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] validate_networks() for [('35c67dd6-0cd8-4c15-89ef-e2378e814739', None, None, None, None, None)] {{(pid=61666) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Flavor limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Image limits 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Flavor pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Image pref 0:0:0 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.virt.hardware [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Getting quotas for project 403b6ebfe1da4ec29a83f25db6cee5db. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.quota [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Getting quotas for user 2f969660d70f4543b930728e8a5f3db2 and project 403b6ebfe1da4ec29a83f25db6cee5db. Resources: {'instances', 'ram', 'cores'} {{(pid=61666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Going to run 1 instances... {{(pid=61666) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 18:55:03 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aa98aa29-97c5-4e4c-b9d9-720fd5982785',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 18:55:03 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-616f1451-fe5b-4f04-ae31-cb8f93356a99 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.895411 Apr 20 18:55:03 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 135/407] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 18:55:02 2023] POST /compute/v2.1/servers => generated 403 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 18:55:03 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-36d0823e-04ab-4e60-b899-b44ca3e1c371 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:03 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-36d0823e-04ab-4e60-b899-b44ca3e1c371 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:03 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-36d0823e-04ab-4e60-b899-b44ca3e1c371 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f969660d70f4543b930728e8a5f3db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b6ebfe1da4ec29a83f25db6cee5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:55:03 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-36d0823e-04ab-4e60-b899-b44ca3e1c371 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f" status: 200 len: 1257 microversion: 2.1 time: 0.266236 Apr 20 18:55:03 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 138/408] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:55:03 2023] GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f => generated 1257 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:55:07 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-cbd68895-d32b-4431-b17c-52a6b7076602 req-92b1d6e4-704a-4217-ba7d-1185f7f40f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5abdc0b8-60e7-4b06-a2d5-45256d97d66f", "tag": "20aa826d-eb82-48c7-be2f-945090efccca"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:07 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-cbd68895-d32b-4431-b17c-52a6b7076602 req-92b1d6e4-704a-4217-ba7d-1185f7f40f45 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:07 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-cbd68895-d32b-4431-b17c-52a6b7076602 req-92b1d6e4-704a-4217-ba7d-1185f7f40f45 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:07 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-cbd68895-d32b-4431-b17c-52a6b7076602 req-92b1d6e4-704a-4217-ba7d-1185f7f40f45 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:07 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-cbd68895-d32b-4431-b17c-52a6b7076602 req-92b1d6e4-704a-4217-ba7d-1185f7f40f45 service nova] Creating event network-changed:20aa826d-eb82-48c7-be2f-945090efccca for instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f on user Apr 20 18:55:07 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-cbd68895-d32b-4431-b17c-52a6b7076602 req-92b1d6e4-704a-4217-ba7d-1185f7f40f45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224935 Apr 20 18:55:07 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:09 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-10d30259-4707-42b3-8ee4-494a7aca0e20 req-5409d2a2-1cbf-4384-9ec3-b74bb40ca5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abdc0b8-60e7-4b06-a2d5-45256d97d66f", "name": "network-vif-plugged", "status": "completed", "tag": "20aa826d-eb82-48c7-be2f-945090efccca"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:09 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-10d30259-4707-42b3-8ee4-494a7aca0e20 req-5409d2a2-1cbf-4384-9ec3-b74bb40ca5ef service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:09 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-10d30259-4707-42b3-8ee4-494a7aca0e20 req-5409d2a2-1cbf-4384-9ec3-b74bb40ca5ef service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:09 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-10d30259-4707-42b3-8ee4-494a7aca0e20 req-5409d2a2-1cbf-4384-9ec3-b74bb40ca5ef service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:09 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-10d30259-4707-42b3-8ee4-494a7aca0e20 req-5409d2a2-1cbf-4384-9ec3-b74bb40ca5ef service nova] Creating event network-vif-plugged:20aa826d-eb82-48c7-be2f-945090efccca for instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f on user Apr 20 18:55:09 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-10d30259-4707-42b3-8ee4-494a7aca0e20 req-5409d2a2-1cbf-4384-9ec3-b74bb40ca5ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162894 Apr 20 18:55:09 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 136/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:10 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:55:10 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-fde74398-4f6b-4778-b954-0d37edf1fb9f tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 200 len: 1537 microversion: 2.1 time: 0.312490 Apr 20 18:55:10 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:55:10 2023] GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 1537 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:55:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell0:SELECT=4 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:11 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-1822d186-2144-4b34-b541-d8cfd951d843 req-ca40971a-67a3-4e36-8938-6eabbcda550d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abdc0b8-60e7-4b06-a2d5-45256d97d66f", "name": "network-vif-plugged", "status": "completed", "tag": "20aa826d-eb82-48c7-be2f-945090efccca"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-1822d186-2144-4b34-b541-d8cfd951d843 req-ca40971a-67a3-4e36-8938-6eabbcda550d service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-1822d186-2144-4b34-b541-d8cfd951d843 req-ca40971a-67a3-4e36-8938-6eabbcda550d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-1822d186-2144-4b34-b541-d8cfd951d843 req-ca40971a-67a3-4e36-8938-6eabbcda550d service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:11 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-1822d186-2144-4b34-b541-d8cfd951d843 req-ca40971a-67a3-4e36-8938-6eabbcda550d service nova] Creating event network-vif-plugged:20aa826d-eb82-48c7-be2f-945090efccca for instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f on user Apr 20 18:55:11 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-1822d186-2144-4b34-b541-d8cfd951d843 req-ca40971a-67a3-4e36-8938-6eabbcda550d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034428 Apr 20 18:55:11 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 137/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=6 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] [instance: 7f9a049b-d419-42e1-a458-41043de315f1] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:14 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] HTTP exception thrown: Instance 7f9a049b-d419-42e1-a458-41043de315f1 could not be found. Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Request method failure captured: Apr 20 18:55:14 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 HTTP/1.1 Apr 20 18:55:14 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:55:14 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:55:14 user devstack@n-api.service[61666]: Connection: close Apr 20 18:55:14 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:55:14 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:55:14 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:55:14 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:55:14 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYhgtRIezK7bo8fL0O4MwlXym_N9uexdl5NNIrHv_yCUFgMBygqXb84uAIXnTc5SgF-tEvBvDnbF288ry4gLHZmI5P7Va7IfK4k7GX-d-YDy02SY1Uf6P8q3OGgTEFCJsEW0HEhxW45k5pXInKLVEn94CPziJ-8a3wpG1UKY7XwcJDg Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Project-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/455e6c598311404f90884c282f25c9bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/455e6c598311404f90884c282f25c9bd"}]}] Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Tenant-Id: 455e6c598311404f90884c282f25c9bd Apr 20 18:55:14 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284 Apr 20 18:55:14 user devstack@n-api.service[61666]: X-User: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:55:14 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:55:14 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:55:14 user devstack@n-api.service[61666]: X-User-Id: 1332e51aa657411cb00f200b592c39f1 Apr 20 18:55:14 user devstack@n-api.service[61666]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member Apr 20 18:55:14 user devstack@n-api.service[61666]: method: > Apr 20 18:55:14 user devstack@n-api.service[61666]: exception: Instance 7f9a049b-d419-42e1-a458-41043de315f1 could not be found. Apr 20 18:55:14 user devstack@n-api.service[61666]: action_args: {'id': '7f9a049b-d419-42e1-a458-41043de315f1'} Apr 20 18:55:14 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f9a049b-d419-42e1-a458-41043de315f1 could not be found. Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f9a049b-d419-42e1-a458-41043de315f1 could not be found. Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f9a049b-d419-42e1-a458-41043de315f1 could not be found. Apr 20 18:55:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] Returning 404 to user: Instance 7f9a049b-d419-42e1-a458-41043de315f1 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:55:14 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f901d3e0-f099-45d8-9931-fc0ed8b48e9b tempest-ServerBootFromVolumeStableRescueTest-134269284 tempest-ServerBootFromVolumeStableRescueTest-134269284-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1" status: 404 len: 111 microversion: 2.87 time: 0.033789 Apr 20 18:55:14 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 137/413] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:55:14 2023] GET /compute/v2.1/servers/7f9a049b-d419-42e1-a458-41043de315f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:55:19 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:19 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8dae73b6-59ab-4751-aa91-1096cf3c254a tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Action: 'create', calling method: .version_select at 0x7fe63eab7880>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-514890240"}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:19 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:19 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8dae73b6-59ab-4751-aa91-1096cf3c254a tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.525075 Apr 20 18:55:19 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 140/414] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 18:55:19 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 527 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 18:55:19 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-f31aa2b2-20b8-470a-bf4f-1df2e1c86540 tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Calling method '.version_select at 0x7fe63e9839a0>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:19 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-f31aa2b2-20b8-470a-bf4f-1df2e1c86540 tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631" status: 200 len: 341 microversion: 2.1 time: 0.053270 Apr 20 18:55:19 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 138/415] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:55:19 2023] GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 => generated 341 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:19 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-cb453678-9191-4977-bba1-eea3f08d7eec tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.423337 Apr 20 18:55:19 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 138/416] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 18:55:19 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad/os-interface => generated 283 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:55:20 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=8 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [req-13ac31f8-ac05-454e-bfc5-101acb146f48 req-bbf5281d-a312-48a0-9583-14cf8980b243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-13ac31f8-ac05-454e-bfc5-101acb146f48 req-bbf5281d-a312-48a0-9583-14cf8980b243 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:20 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-91cafbd5-efb9-4284-948f-65ffd8b1b116 tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Calling method '.version_select at 0x7fe63e983520>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-13ac31f8-ac05-454e-bfc5-101acb146f48 req-bbf5281d-a312-48a0-9583-14cf8980b243 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:20 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [req-13ac31f8-ac05-454e-bfc5-101acb146f48 req-bbf5281d-a312-48a0-9583-14cf8980b243 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.compute.server_external_events [req-13ac31f8-ac05-454e-bfc5-101acb146f48 req-bbf5281d-a312-48a0-9583-14cf8980b243 service nova] Creating event network-changed:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [req-13ac31f8-ac05-454e-bfc5-101acb146f48 req-bbf5281d-a312-48a0-9583-14cf8980b243 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039905 Apr 20 18:55:20 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 141/417] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:20 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:20 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-91cafbd5-efb9-4284-948f-65ffd8b1b116 tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631" status: 200 len: 341 microversion: 2.1 time: 0.064248 Apr 20 18:55:20 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:55:20 2023] GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 => generated 341 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:20 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-c643d107-dd1a-4ab7-bd37-57dc80162433 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad/ips" status: 200 len: 110 microversion: 2.20 time: 0.036788 Apr 20 18:55:20 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 139/419] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 18:55:20 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad/ips => generated 110 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 18:55:20 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-1730dbad-c7f0-4d0d-b417-2e4666557038 tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Calling method '.version_select at 0x7fe63eab6710>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:20 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-1730dbad-c7f0-4d0d-b417-2e4666557038 tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631" status: 202 len: 0 microversion: 2.1 time: 0.145692 Apr 20 18:55:20 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 142/420] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:55:20 2023] DELETE /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:55:20 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-dfb1dc02-bceb-496e-b367-b8ccab99c0ed tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Calling method '.version_select at 0x7fe63eaeb9a0>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-dfb1dc02-bceb-496e-b367-b8ccab99c0ed tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] HTTP exception thrown: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. Apr 20 18:55:21 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-dfb1dc02-bceb-496e-b367-b8ccab99c0ed tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Request method failure captured: Apr 20 18:55:21 user devstack@n-api.service[61666]: request: GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 HTTP/1.1 Apr 20 18:55:21 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:55:21 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:55:21 user devstack@n-api.service[61666]: Connection: close Apr 20 18:55:21 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:55:21 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:55:21 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:55:21 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:55:21 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYqXTWQB4Y3MSrn4OLSGsHURa2kAwOW83Uc1jg_ZECrdmYYHMCKVQ-iKU5VH3SQFo1gnT3laaaDsE7D-IkaLwHnEKde-6W0w137EljH7VbEPpYyaFkAqmlm3qhsjuHuz_-2YPlq_eBfG9kYRPGeyLP8uIdxcQD27cU5EHbG30GH7i2A Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Project-Id: 83f5be83a3c2498db12d4e8fbaffffc1 Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1419190793 Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83f5be83a3c2498db12d4e8fbaffffc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83f5be83a3c2498db12d4e8fbaffffc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83f5be83a3c2498db12d4e8fbaffffc1"}]}] Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1419190793 Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Tenant-Id: 83f5be83a3c2498db12d4e8fbaffffc1 Apr 20 18:55:21 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1419190793 Apr 20 18:55:21 user devstack@n-api.service[61666]: X-User: tempest-VolumesSnapshotsTestJSON-1419190793-project-member Apr 20 18:55:21 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:55:21 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:55:21 user devstack@n-api.service[61666]: X-User-Id: d15ef044ef7d4934a1299e9f3f8f795a Apr 20 18:55:21 user devstack@n-api.service[61666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1419190793-project-member Apr 20 18:55:21 user devstack@n-api.service[61666]: method: Apr 20 18:55:21 user devstack@n-api.service[61666]: exception: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. Apr 20 18:55:21 user devstack@n-api.service[61666]: action_args: {'id': 'a55bb7fc-bff1-4cc3-b9f0-c6ed31259631'} Apr 20 18:55:21 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. (HTTP 404) (Request-ID: req-c7ff8016-c23c-459f-9a3d-64e1e8213384) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. Apr 20 18:55:21 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:55:21 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-dfb1dc02-bceb-496e-b367-b8ccab99c0ed tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] Returning 404 to user: Volume a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:55:21 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-dfb1dc02-bceb-496e-b367-b8ccab99c0ed tempest-VolumesSnapshotsTestJSON-1419190793 tempest-VolumesSnapshotsTestJSON-1419190793-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631" status: 404 len: 109 microversion: 2.1 time: 0.042802 Apr 20 18:55:21 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 18:55:20 2023] GET /compute/v2.1/os-volumes/a55bb7fc-bff1-4cc3-b9f0-c6ed31259631 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:22 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Going to try to terminate instance {{(pid=61668) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:55:22 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-44e59846-710a-4a98-b3da-414247571056 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 204 len: 0 microversion: 2.20 time: 0.156011 Apr 20 18:55:22 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 140/422] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:55:22 2023] DELETE /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:22 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-01d70653-ef2c-4dac-8207-7cd4c6be6a80 req-0ecfa9bf-0c0b-41e7-a396-73925d3a527c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-unplugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-01d70653-ef2c-4dac-8207-7cd4c6be6a80 req-0ecfa9bf-0c0b-41e7-a396-73925d3a527c service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-01d70653-ef2c-4dac-8207-7cd4c6be6a80 req-0ecfa9bf-0c0b-41e7-a396-73925d3a527c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:22 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-01d70653-ef2c-4dac-8207-7cd4c6be6a80 req-0ecfa9bf-0c0b-41e7-a396-73925d3a527c service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-01d70653-ef2c-4dac-8207-7cd4c6be6a80 req-0ecfa9bf-0c0b-41e7-a396-73925d3a527c service nova] Creating event network-vif-unplugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:22 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-01d70653-ef2c-4dac-8207-7cd4c6be6a80 req-0ecfa9bf-0c0b-41e7-a396-73925d3a527c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033181 Apr 20 18:55:22 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 141/423] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:55:22 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3f1d66bdeebc4100a788e4e8b81eacb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27ae1955293e49b5a61280cee2084292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:55:22 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-1f7ba72c-c110-40b6-9860-80a5c529874f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 200 len: 1712 microversion: 2.20 time: 0.247646 Apr 20 18:55:22 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 143/424] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:55:22 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 1712 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 18:55:24 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-6afee64e-f5cf-481a-8bcc-15da0dc06b2d req-2331cd5b-6b24-4484-a2ed-66fa8a0b4b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-deleted", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6afee64e-f5cf-481a-8bcc-15da0dc06b2d req-2331cd5b-6b24-4484-a2ed-66fa8a0b4b57 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6afee64e-f5cf-481a-8bcc-15da0dc06b2d req-2331cd5b-6b24-4484-a2ed-66fa8a0b4b57 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:24 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-6afee64e-f5cf-481a-8bcc-15da0dc06b2d req-2331cd5b-6b24-4484-a2ed-66fa8a0b4b57 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:24 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-6afee64e-f5cf-481a-8bcc-15da0dc06b2d req-2331cd5b-6b24-4484-a2ed-66fa8a0b4b57 service nova] Creating event network-vif-deleted:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:24 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-6afee64e-f5cf-481a-8bcc-15da0dc06b2d req-2331cd5b-6b24-4484-a2ed-66fa8a0b4b57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030909 Apr 20 18:55:24 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 141/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:24 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-plugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}, {"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-plugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}, {"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-plugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}, {"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-unplugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}, {"server_uuid": "2d6c1b8e-1dda-4db8-8800-640cd99625ad", "name": "network-vif-plugged", "status": "completed", "tag": "dd74e240-aa26-4019-8df6-9deeb60aded5"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:55:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:24 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Creating event network-vif-plugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Creating event network-vif-plugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Creating event network-vif-plugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Creating event network-vif-unplugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] Creating event network-vif-plugged:dd74e240-aa26-4019-8df6-9deeb60aded5 for instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad on user Apr 20 18:55:24 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-388e31e7-7575-460c-94ba-5f3008cbd49b req-1735606b-5815-451b-bb38-5a8cd3ee81ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032876 Apr 20 18:55:24 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 142/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:55:24 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:55:53 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:53 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=14 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:55:53 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:55:53 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:55:54 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f969660d70f4543b930728e8a5f3db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b6ebfe1da4ec29a83f25db6cee5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:55:54 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8fd00d2d-9d78-4ae1-9943-9cad3f3b161d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f" status: 200 len: 1567 microversion: 2.1 time: 0.219686 Apr 20 18:55:54 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 144/427] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:55:53 2023] GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:11 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:56:11 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-c7387450-edf7-4e9c-9f64-a561353aeddc tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 200 len: 1537 microversion: 2.1 time: 0.255283 Apr 20 18:56:11 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 142/428] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:56:11 2023] GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 1537 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=10 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Searching by: {'deleted': False, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed'} {{(pid=61666) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:11 user devstack@n-api.service[61666]: DEBUG nova.compute.multi_cell_list [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61666) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 18:56:11 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-98744ba0-48a8-407c-bb2f-89328135dab8 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.187916 Apr 20 18:56:11 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 143/429] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 18:56:11 2023] GET /compute/v2.1/servers => generated 341 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=2 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=6 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:11 user devstack@n-api.service[61667]: DEBUG nova.policy [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61667) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:56:11 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-8d1d8224-1b7a-46cb-ae3e-ccad1320b86b tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 200 len: 1537 microversion: 2.1 time: 0.238963 Apr 20 18:56:11 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 145/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:56:11 2023] GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 1537 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:12 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] HTTP exception thrown: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Request method failure captured: Apr 20 18:56:12 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad HTTP/1.1 Apr 20 18:56:12 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:56:12 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:56:12 user devstack@n-api.service[61668]: Connection: close Apr 20 18:56:12 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:56:12 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:56:12 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:56:12 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:56:12 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYl-XhuIfV2gGwUio0Oe3UB-HaUbQIvrMmr3rV0caVHtfodeH08h0ZR_b5e2SP4vGX0VoE77vSlQwsSog3Ns-OwyVRPzbVLNdz-bFQswaO-fDHJXf477kXUv_SsXfw5QClMarYNwKHQcyB4yAf2RvfGvkHkUgSF9ulF4vOlWnYi7C3k Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Project-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27ae1955293e49b5a61280cee2084292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}] Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Tenant-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-User: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:12 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:56:12 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:56:12 user devstack@n-api.service[61668]: X-User-Id: 3f1d66bdeebc4100a788e4e8b81eacb8 Apr 20 18:56:12 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:12 user devstack@n-api.service[61668]: method: > Apr 20 18:56:12 user devstack@n-api.service[61668]: exception: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:12 user devstack@n-api.service[61668]: action_args: {'id': '2d6c1b8e-1dda-4db8-8800-640cd99625ad'} Apr 20 18:56:12 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:12 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:12 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Returning 404 to user: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:56:12 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d74bb214-30cf-4a1e-83c4-72dee3a107ab tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 404 len: 111 microversion: 2.20 time: 0.247320 Apr 20 18:56:12 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 143/431] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:56:12 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:56:12 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-ab528191-019e-4219-a46e-fa95bae0ea0f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '.version_select at 0x7fe63eaeb880>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:13 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-ab528191-019e-4219-a46e-fa95bae0ea0f tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346840745" status: 204 len: 0 microversion: 2.20 time: 0.027202 Apr 20 18:56:13 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 144/432] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 18:56:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346840745 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:56:13 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-74ab3e05-def0-4154-add4-2da64b586468 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 204 len: 0 microversion: 2.1 time: 0.122671 Apr 20 18:56:13 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 146/433] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:56:13 2023] DELETE /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b158eae659ca4ba2bb2672a295d37578', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '451697ad3ab142a4a6ce04b41fb589ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:56:13 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-d4ada067-4641-40fe-92b9-3d89a904c455 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 200 len: 1543 microversion: 2.1 time: 0.228919 Apr 20 18:56:13 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 144/434] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:56:13 2023] GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 1543 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:56:13 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-c68ae959-da46-419f-a67a-cfb498ebfdfd req-a69de9d0-1cbc-41c8-b9a5-3b709ade3bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-unplugged", "status": "completed", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:56:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c68ae959-da46-419f-a67a-cfb498ebfdfd req-a69de9d0-1cbc-41c8-b9a5-3b709ade3bba service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c68ae959-da46-419f-a67a-cfb498ebfdfd req-a69de9d0-1cbc-41c8-b9a5-3b709ade3bba service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-c68ae959-da46-419f-a67a-cfb498ebfdfd req-a69de9d0-1cbc-41c8-b9a5-3b709ade3bba service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-c68ae959-da46-419f-a67a-cfb498ebfdfd req-a69de9d0-1cbc-41c8-b9a5-3b709ade3bba service nova] Creating event network-vif-unplugged:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:56:13 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-c68ae959-da46-419f-a67a-cfb498ebfdfd req-a69de9d0-1cbc-41c8-b9a5-3b709ade3bba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039969 Apr 20 18:56:13 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 145/435] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:56:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] HTTP exception thrown: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Request method failure captured: Apr 20 18:56:13 user devstack@n-api.service[61667]: request: DELETE /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad HTTP/1.1 Apr 20 18:56:13 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:56:13 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:56:13 user devstack@n-api.service[61667]: Connection: close Apr 20 18:56:13 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:56:13 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:56:13 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:56:13 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:56:13 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYl-XhuIfV2gGwUio0Oe3UB-HaUbQIvrMmr3rV0caVHtfodeH08h0ZR_b5e2SP4vGX0VoE77vSlQwsSog3Ns-OwyVRPzbVLNdz-bFQswaO-fDHJXf477kXUv_SsXfw5QClMarYNwKHQcyB4yAf2RvfGvkHkUgSF9ulF4vOlWnYi7C3k Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Project-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27ae1955293e49b5a61280cee2084292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}] Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Tenant-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-User: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:13 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:56:13 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:56:13 user devstack@n-api.service[61667]: X-User-Id: 3f1d66bdeebc4100a788e4e8b81eacb8 Apr 20 18:56:13 user devstack@n-api.service[61667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:13 user devstack@n-api.service[61667]: method: > Apr 20 18:56:13 user devstack@n-api.service[61667]: exception: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61667]: action_args: {'id': '2d6c1b8e-1dda-4db8-8800-640cd99625ad'} Apr 20 18:56:13 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Returning 404 to user: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:56:13 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-7225dbdc-ac4c-46a6-b274-d8d060d656a5 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 404 len: 111 microversion: 2.20 time: 0.033878 Apr 20 18:56:13 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 147/436] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:56:13 2023] DELETE /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 2d6c1b8e-1dda-4db8-8800-640cd99625ad] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:13 user devstack@n-api.service[61668]: INFO nova.api.openstack.wsgi [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] HTTP exception thrown: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Request method failure captured: Apr 20 18:56:13 user devstack@n-api.service[61668]: request: GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad HTTP/1.1 Apr 20 18:56:13 user devstack@n-api.service[61668]: Accept: application/json Apr 20 18:56:13 user devstack@n-api.service[61668]: Accept-Encoding: identity Apr 20 18:56:13 user devstack@n-api.service[61668]: Connection: close Apr 20 18:56:13 user devstack@n-api.service[61668]: Content-Length: 0 Apr 20 18:56:13 user devstack@n-api.service[61668]: Content-Type: application/json Apr 20 18:56:13 user devstack@n-api.service[61668]: Host: 10.0.0.210 Apr 20 18:56:13 user devstack@n-api.service[61668]: Openstack-System-Scope: None Apr 20 18:56:13 user devstack@n-api.service[61668]: User-Agent: python-urllib3/1.26.15 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Auth-Token: gAAAAABkQYl-XhuIfV2gGwUio0Oe3UB-HaUbQIvrMmr3rV0caVHtfodeH08h0ZR_b5e2SP4vGX0VoE77vSlQwsSog3Ns-OwyVRPzbVLNdz-bFQswaO-fDHJXf477kXUv_SsXfw5QClMarYNwKHQcyB4yAf2RvfGvkHkUgSF9ulF4vOlWnYi7C3k Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Domain-Id: None Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Domain-Name: None Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Identity-Status: Confirmed Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Is-Admin-Project: True Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Project-Domain-Id: default Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Project-Domain-Name: Default Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Project-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Role: reader,member Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Roles: reader,member Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27ae1955293e49b5a61280cee2084292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}] Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Tenant-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-User: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:13 user devstack@n-api.service[61668]: X-User-Domain-Id: default Apr 20 18:56:13 user devstack@n-api.service[61668]: X-User-Domain-Name: Default Apr 20 18:56:13 user devstack@n-api.service[61668]: X-User-Id: 3f1d66bdeebc4100a788e4e8b81eacb8 Apr 20 18:56:13 user devstack@n-api.service[61668]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:13 user devstack@n-api.service[61668]: method: > Apr 20 18:56:13 user devstack@n-api.service[61668]: exception: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61668]: action_args: {'id': '2d6c1b8e-1dda-4db8-8800-640cd99625ad'} Apr 20 18:56:13 user devstack@n-api.service[61668]: {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. Apr 20 18:56:13 user devstack@n-api.service[61668]: ERROR nova.api.openstack.wsgi Apr 20 18:56:13 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Returning 404 to user: Instance 2d6c1b8e-1dda-4db8-8800-640cd99625ad could not be found. {{(pid=61668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:56:13 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-8d540ac5-f984-4034-9df8-674d4b62ce77 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad" status: 404 len: 111 microversion: 2.20 time: 0.036027 Apr 20 18:56:13 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 145/437] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:56:13 2023] GET /compute/v2.1/servers/2d6c1b8e-1dda-4db8-8800-640cd99625ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:14 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] HTTP exception thrown: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Request method failure captured: Apr 20 18:56:14 user devstack@n-api.service[61666]: request: DELETE /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 HTTP/1.1 Apr 20 18:56:14 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:56:14 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:56:14 user devstack@n-api.service[61666]: Connection: close Apr 20 18:56:14 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:56:14 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:56:14 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:56:14 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:56:14 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYl-XhuIfV2gGwUio0Oe3UB-HaUbQIvrMmr3rV0caVHtfodeH08h0ZR_b5e2SP4vGX0VoE77vSlQwsSog3Ns-OwyVRPzbVLNdz-bFQswaO-fDHJXf477kXUv_SsXfw5QClMarYNwKHQcyB4yAf2RvfGvkHkUgSF9ulF4vOlWnYi7C3k Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Project-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27ae1955293e49b5a61280cee2084292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}] Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Tenant-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-User: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:14 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:56:14 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:56:14 user devstack@n-api.service[61666]: X-User-Id: 3f1d66bdeebc4100a788e4e8b81eacb8 Apr 20 18:56:14 user devstack@n-api.service[61666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:14 user devstack@n-api.service[61666]: method: > Apr 20 18:56:14 user devstack@n-api.service[61666]: exception: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61666]: action_args: {'id': '0c417042-c579-4e4b-b2fd-94a36e75baf8'} Apr 20 18:56:14 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Returning 404 to user: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:56:14 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-2624bf6b-c760-44ca-b5a1-ef542b1e6ff2 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 404 len: 111 microversion: 2.20 time: 0.032139 Apr 20 18:56:14 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 146/438] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 18:56:14 2023] DELETE /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] [instance: 0c417042-c579-4e4b-b2fd-94a36e75baf8] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] HTTP exception thrown: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Request method failure captured: Apr 20 18:56:14 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 HTTP/1.1 Apr 20 18:56:14 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:56:14 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:56:14 user devstack@n-api.service[61667]: Connection: close Apr 20 18:56:14 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:56:14 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:56:14 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:56:14 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:56:14 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYl-XhuIfV2gGwUio0Oe3UB-HaUbQIvrMmr3rV0caVHtfodeH08h0ZR_b5e2SP4vGX0VoE77vSlQwsSog3Ns-OwyVRPzbVLNdz-bFQswaO-fDHJXf477kXUv_SsXfw5QClMarYNwKHQcyB4yAf2RvfGvkHkUgSF9ulF4vOlWnYi7C3k Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Project-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/27ae1955293e49b5a61280cee2084292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/27ae1955293e49b5a61280cee2084292"}]}] Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Tenant-Id: 27ae1955293e49b5a61280cee2084292 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1009585625 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-User: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:14 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:56:14 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:56:14 user devstack@n-api.service[61667]: X-User-Id: 3f1d66bdeebc4100a788e4e8b81eacb8 Apr 20 18:56:14 user devstack@n-api.service[61667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1009585625-project-member Apr 20 18:56:14 user devstack@n-api.service[61667]: method: > Apr 20 18:56:14 user devstack@n-api.service[61667]: exception: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61667]: action_args: {'id': '0c417042-c579-4e4b-b2fd-94a36e75baf8'} Apr 20 18:56:14 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. Apr 20 18:56:14 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:56:14 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] Returning 404 to user: Instance 0c417042-c579-4e4b-b2fd-94a36e75baf8 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:56:14 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-95b84474-a7a0-4dcf-b8d9-f96cd70e72a9 tempest-AttachVolumeShelveTestJSON-1009585625 tempest-AttachVolumeShelveTestJSON-1009585625-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8" status: 404 len: 111 microversion: 2.20 time: 0.028033 Apr 20 18:56:14 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 148/439] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 18:56:14 2023] GET /compute/v2.1/servers/0c417042-c579-4e4b-b2fd-94a36e75baf8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 18:56:15 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-plugged", "status": "completed", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}, {"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-plugged", "status": "completed", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}, {"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-plugged", "status": "completed", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}, {"server_uuid": "d7a77045-a3c7-4f19-a6ec-eea68d68f796", "name": "network-vif-deleted", "tag": "d4a5cb70-6022-4726-9e2e-5c647690be25"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:56:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:15 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Creating event network-vif-plugged:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:56:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Creating event network-vif-plugged:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:56:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Creating event network-vif-plugged:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:56:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] Creating event network-vif-deleted:d4a5cb70-6022-4726-9e2e-5c647690be25 for instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 on user Apr 20 18:56:15 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-fc41d0b4-f0bd-4eda-8c29-1acabb511920 req-b8c21a8a-9f1b-4840-b262-67a4de3e2bd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.031572 Apr 20 18:56:15 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 146/440] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:56:15 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell0:SELECT=2 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=12 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:54 user devstack@n-api.service[61666]: DEBUG nova.policy [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f969660d70f4543b930728e8a5f3db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b6ebfe1da4ec29a83f25db6cee5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61666) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:56:54 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-57ddd9cd-f899-43d6-a5db-45d5ad10926d tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f" status: 200 len: 1567 microversion: 2.1 time: 0.271482 Apr 20 18:56:54 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:56:54 2023] GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f => generated 1567 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:56 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Going to try to terminate instance {{(pid=61667) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 18:56:56 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-70bd0b52-fd0b-4a84-806b-5cb3a7c7ccf3 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f" status: 204 len: 0 microversion: 2.1 time: 0.134726 Apr 20 18:56:56 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 18:56:56 2023] DELETE /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG nova.compute.api [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Fetching instance by UUID {{(pid=61668) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_api:SELECT=10 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG dbcounter [-] [61668] Writing DB stats nova_cell1:SELECT=18 {{(pid=61668) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:56 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-1e7a48f4-2389-4c99-86f2-bc7be4a5a460 req-bd9dc2f5-f34f-40cf-ac83-c22c8d88d178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abdc0b8-60e7-4b06-a2d5-45256d97d66f", "name": "network-vif-unplugged", "status": "completed", "tag": "20aa826d-eb82-48c7-be2f-945090efccca"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:56:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-1e7a48f4-2389-4c99-86f2-bc7be4a5a460 req-bd9dc2f5-f34f-40cf-ac83-c22c8d88d178 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-1e7a48f4-2389-4c99-86f2-bc7be4a5a460 req-bd9dc2f5-f34f-40cf-ac83-c22c8d88d178 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:56 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-1e7a48f4-2389-4c99-86f2-bc7be4a5a460 req-bd9dc2f5-f34f-40cf-ac83-c22c8d88d178 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:56 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-1e7a48f4-2389-4c99-86f2-bc7be4a5a460 req-bd9dc2f5-f34f-40cf-ac83-c22c8d88d178 service nova] Creating event network-vif-unplugged:20aa826d-eb82-48c7-be2f-945090efccca for instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f on user Apr 20 18:56:56 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-1e7a48f4-2389-4c99-86f2-bc7be4a5a460 req-bd9dc2f5-f34f-40cf-ac83-c22c8d88d178 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033104 Apr 20 18:56:56 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:56:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:56:56 user devstack@n-api.service[61668]: DEBUG nova.policy [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f969660d70f4543b930728e8a5f3db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b6ebfe1da4ec29a83f25db6cee5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61668) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 18:56:56 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-cab081a8-7461-461a-9228-106b9bb59241 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f" status: 200 len: 1573 microversion: 2.1 time: 0.338438 Apr 20 18:56:56 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 147/444] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:56:56 2023] GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f => generated 1573 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 18:56:58 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [req-6c1fe954-eb42-4c14-af0e-f83c140f0787 req-52ba556e-e438-4c44-8c83-8390ff804d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abdc0b8-60e7-4b06-a2d5-45256d97d66f", "name": "network-vif-deleted", "tag": "20aa826d-eb82-48c7-be2f-945090efccca"}]} {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:56:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-6c1fe954-eb42-4c14-af0e-f83c140f0787 req-52ba556e-e438-4c44-8c83-8390ff804d01 service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-6c1fe954-eb42-4c14-af0e-f83c140f0787 req-52ba556e-e438-4c44-8c83-8390ff804d01 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:58 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [req-6c1fe954-eb42-4c14-af0e-f83c140f0787 req-52ba556e-e438-4c44-8c83-8390ff804d01 service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:58 user devstack@n-api.service[61666]: INFO nova.api.openstack.compute.server_external_events [req-6c1fe954-eb42-4c14-af0e-f83c140f0787 req-52ba556e-e438-4c44-8c83-8390ff804d01 service nova] Creating event network-vif-deleted:20aa826d-eb82-48c7-be2f-945090efccca for instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f on user Apr 20 18:56:58 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [req-6c1fe954-eb42-4c14-af0e-f83c140f0787 req-52ba556e-e438-4c44-8c83-8390ff804d01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041277 Apr 20 18:56:58 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 149/445] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:56:58 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-e0ce321b-9440-4d8b-94c5-17079f1cf1c5 tempest-TestStampPattern-1114290550 tempest-TestStampPattern-1114290550-project-member] Action: 'create', calling method: .version_select at 0x7fe63eab7910>, body: {"keypair": {"name": "tempest-TestStampPattern-1474408453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFigdlgkyCFDX1slrPP5dZRwisdOh6dalqWscnaJ+UyjO6sEdbZI92hvjrAOMrrZmGOvrzur5xYPzRglDkLsxZakMzqDM0DP8uE0k221+wj7YrffbqNi/iWOmdK5a3dhPQ=="}} {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:56:58 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-e0ce321b-9440-4d8b-94c5-17079f1cf1c5 tempest-TestStampPattern-1114290550 tempest-TestStampPattern-1114290550-project-member] Getting quotas for project 8becb69b6fa24d79a6a39013b43808a9. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 18:56:58 user devstack@n-api.service[61667]: DEBUG nova.quota [None req-e0ce321b-9440-4d8b-94c5-17079f1cf1c5 tempest-TestStampPattern-1114290550 tempest-TestStampPattern-1114290550-project-member] Getting quotas for user 3db0768c743442668a5a0d5d2be1dc57 and project 8becb69b6fa24d79a6a39013b43808a9. Resources: {'key_pairs'} {{(pid=61667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 18:56:58 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-e0ce321b-9440-4d8b-94c5-17079f1cf1c5 tempest-TestStampPattern-1114290550 tempest-TestStampPattern-1114290550-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.357313 Apr 20 18:56:58 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 150/446] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 18:56:58 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:56:58 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [req-08190ec5-ed1f-4bb1-ac90-7b168b5a13a8 req-6da30d53-1c77-475b-a85b-494a9ebce4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5abdc0b8-60e7-4b06-a2d5-45256d97d66f", "name": "network-vif-plugged", "status": "completed", "tag": "20aa826d-eb82-48c7-be2f-945090efccca"}]} {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 18:56:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-08190ec5-ed1f-4bb1-ac90-7b168b5a13a8 req-6da30d53-1c77-475b-a85b-494a9ebce4cd service nova] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:56:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-08190ec5-ed1f-4bb1-ac90-7b168b5a13a8 req-6da30d53-1c77-475b-a85b-494a9ebce4cd service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:56:58 user devstack@n-api.service[61668]: DEBUG oslo_concurrency.lockutils [req-08190ec5-ed1f-4bb1-ac90-7b168b5a13a8 req-6da30d53-1c77-475b-a85b-494a9ebce4cd service nova] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61668) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:56:58 user devstack@n-api.service[61668]: INFO nova.api.openstack.compute.server_external_events [req-08190ec5-ed1f-4bb1-ac90-7b168b5a13a8 req-6da30d53-1c77-475b-a85b-494a9ebce4cd service nova] Creating event network-vif-plugged:20aa826d-eb82-48c7-be2f-945090efccca for instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f on user Apr 20 18:56:58 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [req-08190ec5-ed1f-4bb1-ac90-7b168b5a13a8 req-6da30d53-1c77-475b-a85b-494a9ebce4cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046055 Apr 20 18:56:58 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 148/447] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 18:56:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 18:57:01 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-6b8185cd-5a31-4674-95c5-20bbbfdb09a8 tempest-TestStampPattern-1114290550 tempest-TestStampPattern-1114290550-project-member] Calling method '.version_select at 0x7fe63e983250>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:57:01 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-6b8185cd-5a31-4674-95c5-20bbbfdb09a8 tempest-TestStampPattern-1114290550 tempest-TestStampPattern-1114290550-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1474408453" status: 202 len: 0 microversion: 2.1 time: 0.021210 Apr 20 18:57:01 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 150/448] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 18:57:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1474408453 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG nova.compute.api [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] [instance: d7a77045-a3c7-4f19-a6ec-eea68d68f796] Fetching instance by UUID {{(pid=61667) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG oslo_concurrency.lockutils [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61667) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:57:03 user devstack@n-api.service[61667]: INFO nova.api.openstack.wsgi [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] HTTP exception thrown: Instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 could not be found. Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Request method failure captured: Apr 20 18:57:03 user devstack@n-api.service[61667]: request: GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 HTTP/1.1 Apr 20 18:57:03 user devstack@n-api.service[61667]: Accept: application/json Apr 20 18:57:03 user devstack@n-api.service[61667]: Accept-Encoding: identity Apr 20 18:57:03 user devstack@n-api.service[61667]: Connection: close Apr 20 18:57:03 user devstack@n-api.service[61667]: Content-Length: 0 Apr 20 18:57:03 user devstack@n-api.service[61667]: Content-Type: application/json Apr 20 18:57:03 user devstack@n-api.service[61667]: Host: 10.0.0.210 Apr 20 18:57:03 user devstack@n-api.service[61667]: Openstack-System-Scope: None Apr 20 18:57:03 user devstack@n-api.service[61667]: User-Agent: python-urllib3/1.26.15 Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Auth-Token: gAAAAABkQYmrethykD5zW7zWE47VOBlfhaq9vVysRIkVSodZsWD54gimwFJuuIsj44HDrMb1HIWh5G6OypQVKi-xXd2yLcCcfe796qLpcSQ0JXR2ptFADCnrCR8-VEP4ouKGKU6WMIvjGEzGE687UVAXOlKiepPWPG-HZq-ON_CFYPexA7R32uU Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Domain-Id: None Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Domain-Name: None Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Identity-Status: Confirmed Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Is-Admin-Project: True Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Project-Domain-Id: default Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Project-Domain-Name: Default Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Project-Id: 451697ad3ab142a4a6ce04b41fb589ed Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Project-Name: tempest-TestMinimumBasicScenario-1683785897 Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Role: reader,member Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Roles: reader,member Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/451697ad3ab142a4a6ce04b41fb589ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/451697ad3ab142a4a6ce04b41fb589ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/451697ad3ab142a4a6ce04b41fb589ed"}]}] Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Tenant: tempest-TestMinimumBasicScenario-1683785897 Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Tenant-Id: 451697ad3ab142a4a6ce04b41fb589ed Apr 20 18:57:03 user devstack@n-api.service[61667]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1683785897 Apr 20 18:57:03 user devstack@n-api.service[61667]: X-User: tempest-TestMinimumBasicScenario-1683785897-project-member Apr 20 18:57:03 user devstack@n-api.service[61667]: X-User-Domain-Id: default Apr 20 18:57:03 user devstack@n-api.service[61667]: X-User-Domain-Name: Default Apr 20 18:57:03 user devstack@n-api.service[61667]: X-User-Id: b158eae659ca4ba2bb2672a295d37578 Apr 20 18:57:03 user devstack@n-api.service[61667]: X-User-Name: tempest-TestMinimumBasicScenario-1683785897-project-member Apr 20 18:57:03 user devstack@n-api.service[61667]: method: > Apr 20 18:57:03 user devstack@n-api.service[61667]: exception: Instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 could not be found. Apr 20 18:57:03 user devstack@n-api.service[61667]: action_args: {'id': 'd7a77045-a3c7-4f19-a6ec-eea68d68f796'} Apr 20 18:57:03 user devstack@n-api.service[61667]: {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 could not be found. Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 could not be found. Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 could not be found. Apr 20 18:57:03 user devstack@n-api.service[61667]: ERROR nova.api.openstack.wsgi Apr 20 18:57:03 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Returning 404 to user: Instance d7a77045-a3c7-4f19-a6ec-eea68d68f796 could not be found. {{(pid=61667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:57:03 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-6725471b-3c3a-4f11-9d33-67ee49ee1be3 tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796" status: 404 len: 111 microversion: 2.1 time: 0.122799 Apr 20 18:57:03 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:57:03 2023] GET /compute/v2.1/servers/d7a77045-a3c7-4f19-a6ec-eea68d68f796 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:57:03 user devstack@n-api.service[61668]: DEBUG nova.api.openstack.wsgi [None req-02952ee1-d99b-41e9-80b7-c9841ab48c7c tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] Calling method '.version_select at 0x7fe63e747eb0>' {{(pid=61668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:57:03 user devstack@n-api.service[61668]: INFO nova.api.openstack.requestlog [None req-02952ee1-d99b-41e9-80b7-c9841ab48c7c tempest-TestMinimumBasicScenario-1683785897 tempest-TestMinimumBasicScenario-1683785897-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1115122990" status: 202 len: 0 microversion: 2.1 time: 0.027880 Apr 20 18:57:03 user devstack@n-api.service[61668]: [pid: 61668|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 18:57:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1115122990 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_cell1:SELECT=10 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG dbcounter [-] [61666] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61666) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '>' {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG nova.compute.api [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] [instance: 5abdc0b8-60e7-4b06-a2d5-45256d97d66f] Fetching instance by UUID {{(pid=61666) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Acquiring lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG oslo_concurrency.lockutils [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Lock "e570c5e4-d2bb-4eb5-ba69-c1c987d683f8" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61666) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 18:57:46 user devstack@n-api.service[61666]: INFO nova.api.openstack.wsgi [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] HTTP exception thrown: Instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f could not be found. Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Request method failure captured: Apr 20 18:57:46 user devstack@n-api.service[61666]: request: GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f HTTP/1.1 Apr 20 18:57:46 user devstack@n-api.service[61666]: Accept: application/json Apr 20 18:57:46 user devstack@n-api.service[61666]: Accept-Encoding: identity Apr 20 18:57:46 user devstack@n-api.service[61666]: Connection: close Apr 20 18:57:46 user devstack@n-api.service[61666]: Content-Length: 0 Apr 20 18:57:46 user devstack@n-api.service[61666]: Content-Type: application/json Apr 20 18:57:46 user devstack@n-api.service[61666]: Host: 10.0.0.210 Apr 20 18:57:46 user devstack@n-api.service[61666]: Openstack-System-Scope: None Apr 20 18:57:46 user devstack@n-api.service[61666]: User-Agent: python-urllib3/1.26.15 Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Auth-Token: gAAAAABkQYp9l1wEOa_XWA-rmsY2Z2PgLzNmMwbf_48UD41qGd9UdHa7MPQy63dBysu3o2DIygNBYi0iPb6RY4ZU9nXdhV00T94CFeEhPlv9CFoVlRrVGvH4QeQ0PMGXp7QYn_VGf8Qjo5ySOmY3apNyfoFjpb_W5vD_1JwzkglofSC2iyDCyZU Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Domain-Id: None Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Domain-Name: None Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Identity-Status: Confirmed Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Is-Admin-Project: True Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Project-Domain-Id: default Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Project-Domain-Name: Default Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Project-Id: 403b6ebfe1da4ec29a83f25db6cee5db Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Project-Name: tempest-SnapshotDataIntegrityTests-993686934 Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Role: reader,member Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Roles: reader,member Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/403b6ebfe1da4ec29a83f25db6cee5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/403b6ebfe1da4ec29a83f25db6cee5db"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/403b6ebfe1da4ec29a83f25db6cee5db"}]}] Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Tenant: tempest-SnapshotDataIntegrityTests-993686934 Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Tenant-Id: 403b6ebfe1da4ec29a83f25db6cee5db Apr 20 18:57:46 user devstack@n-api.service[61666]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-993686934 Apr 20 18:57:46 user devstack@n-api.service[61666]: X-User: tempest-SnapshotDataIntegrityTests-993686934-project-member Apr 20 18:57:46 user devstack@n-api.service[61666]: X-User-Domain-Id: default Apr 20 18:57:46 user devstack@n-api.service[61666]: X-User-Domain-Name: Default Apr 20 18:57:46 user devstack@n-api.service[61666]: X-User-Id: 2f969660d70f4543b930728e8a5f3db2 Apr 20 18:57:46 user devstack@n-api.service[61666]: X-User-Name: tempest-SnapshotDataIntegrityTests-993686934-project-member Apr 20 18:57:46 user devstack@n-api.service[61666]: method: > Apr 20 18:57:46 user devstack@n-api.service[61666]: exception: Instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f could not be found. Apr 20 18:57:46 user devstack@n-api.service[61666]: action_args: {'id': '5abdc0b8-60e7-4b06-a2d5-45256d97d66f'} Apr 20 18:57:46 user devstack@n-api.service[61666]: {{(pid=61666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f could not be found. Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f could not be found. Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f could not be found. Apr 20 18:57:46 user devstack@n-api.service[61666]: ERROR nova.api.openstack.wsgi Apr 20 18:57:46 user devstack@n-api.service[61666]: DEBUG nova.api.openstack.wsgi [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Returning 404 to user: Instance 5abdc0b8-60e7-4b06-a2d5-45256d97d66f could not be found. {{(pid=61666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 18:57:46 user devstack@n-api.service[61666]: INFO nova.api.openstack.requestlog [None req-0bc68b72-2445-4c61-8ce8-6bf645b52742 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f" status: 404 len: 111 microversion: 2.1 time: 0.032843 Apr 20 18:57:46 user devstack@n-api.service[61666]: [pid: 61666|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 18:57:46 2023] GET /compute/v2.1/servers/5abdc0b8-60e7-4b06-a2d5-45256d97d66f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 18:57:46 user devstack@n-api.service[61667]: DEBUG nova.api.openstack.wsgi [None req-f805a325-11cf-4ff9-9158-5083369cfd88 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] Calling method '.version_select at 0x7fe63eab6320>' {{(pid=61667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 18:57:46 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell0:SELECT=4 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:57:46 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:57:46 user devstack@n-api.service[61667]: DEBUG dbcounter [-] [61667] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61667) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 18:57:46 user devstack@n-api.service[61667]: INFO nova.api.openstack.requestlog [None req-f805a325-11cf-4ff9-9158-5083369cfd88 tempest-SnapshotDataIntegrityTests-993686934 tempest-SnapshotDataIntegrityTests-993686934-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1211787292" status: 202 len: 0 microversion: 2.1 time: 0.036402 Apr 20 18:57:46 user devstack@n-api.service[61667]: [pid: 61667|app: 0|req: 152/452] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 20 18:57:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1211787292 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)