Apr 17 19:13:16 user devstack@n-api.service[61726]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 17 19:13:16 user devstack@n-api.service[61726]: *** Starting uWSGI 2.0.20-debian (64bit) on [Mon Apr 17 19:13:16 2023] *** Apr 17 19:13:16 user devstack@n-api.service[61726]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 17 19:13:16 user devstack@n-api.service[61726]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 17 19:13:16 user devstack@n-api.service[61726]: nodename: user Apr 17 19:13:16 user devstack@n-api.service[61726]: machine: x86_64 Apr 17 19:13:16 user devstack@n-api.service[61726]: clock source: unix Apr 17 19:13:16 user devstack@n-api.service[61726]: pcre jit disabled Apr 17 19:13:16 user devstack@n-api.service[61726]: detected number of CPU cores: 12 Apr 17 19:13:16 user devstack@n-api.service[61726]: current working directory: / Apr 17 19:13:16 user devstack@n-api.service[61726]: detected binary path: /usr/bin/uwsgi-core Apr 17 19:13:16 user devstack@n-api.service[61726]: your processes number limit is 63637 Apr 17 19:13:16 user devstack@n-api.service[61726]: your memory page size is 4096 bytes Apr 17 19:13:16 user devstack@n-api.service[61726]: detected max file descriptor number: 2048 Apr 17 19:13:16 user devstack@n-api.service[61726]: lock engine: pthread robust mutexes Apr 17 19:13:16 user devstack@n-api.service[61726]: thunder lock: enabled Apr 17 19:13:16 user devstack@n-api.service[61726]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 17 19:13:16 user devstack@n-api.service[61726]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 17 19:13:16 user devstack@n-api.service[61726]: Python main interpreter initialized at 0x55b5837d9990 Apr 17 19:13:16 user devstack@n-api.service[61726]: python threads support enabled Apr 17 19:13:16 user devstack@n-api.service[61726]: your server socket listen backlog is limited to 100 connections Apr 17 19:13:16 user devstack@n-api.service[61726]: your mercy for graceful operations on workers is 90 seconds Apr 17 19:13:16 user devstack@n-api.service[61726]: mapped 537436 bytes (524 KB) for 3 cores Apr 17 19:13:16 user devstack@n-api.service[61726]: *** Operational MODE: preforking *** Apr 17 19:13:16 user devstack@n-api.service[61726]: *** uWSGI is running in multiple interpreter mode *** Apr 17 19:13:16 user devstack@n-api.service[61726]: spawned uWSGI master process (pid: 61726) Apr 17 19:13:16 user devstack@n-api.service[61726]: spawned uWSGI worker 1 (pid: 61727, cores: 1) Apr 17 19:13:16 user devstack@n-api.service[61726]: spawned uWSGI worker 2 (pid: 61728, cores: 1) Apr 17 19:13:16 user devstack@n-api.service[61726]: spawned uWSGI worker 3 (pid: 61729, cores: 1) Apr 17 19:13:16 user devstack@n-api.service[61726]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 17 19:13:17 user devstack@n-api.service[61727]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 17 19:13:17 user devstack@n-api.service[61729]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 17 19:13:17 user devstack@n-api.service[61728]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 17 19:13:20 user devstack@n-api.service[61727]: live_migration_uri is deprecated for removal in favor of two other options that Apr 17 19:13:20 user devstack@n-api.service[61727]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 17 19:13:20 user devstack@n-api.service[61727]: and ``live_migration_inbound_addr`` respectively. Apr 17 19:13:20 user devstack@n-api.service[61727]: ). Its value may be silently ignored in the future. Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 17 19:13:20 user devstack@n-api.service[61729]: live_migration_uri is deprecated for removal in favor of two other options that Apr 17 19:13:20 user devstack@n-api.service[61729]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 17 19:13:20 user devstack@n-api.service[61729]: and ``live_migration_inbound_addr`` respectively. Apr 17 19:13:20 user devstack@n-api.service[61729]: ). Its value may be silently ignored in the future. Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 17 19:13:20 user devstack@n-api.service[61728]: live_migration_uri is deprecated for removal in favor of two other options that Apr 17 19:13:20 user devstack@n-api.service[61728]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 17 19:13:20 user devstack@n-api.service[61728]: and ``live_migration_inbound_addr`` respectively. Apr 17 19:13:20 user devstack@n-api.service[61728]: ). Its value may be silently ignored in the future. Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61727) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61729) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61728) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 17 19:13:20 user devstack@n-api.service[61727]: INFO dbcounter [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Registered counter for database nova_api Apr 17 19:13:20 user devstack@n-api.service[61729]: INFO dbcounter [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Registered counter for database nova_api Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_db.sqlalchemy.engines [None req-97e32799-7b34-4348-90a7-44164b409060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61729) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writer thread running {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61728]: INFO dbcounter [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Registered counter for database nova_api Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG nova.context [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),557b61a6-7c46-4750-bdf8-90d5a8f88bb1(cell1) {{(pid=61727) load_cells /opt/stack/nova/nova/context.py:464}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:13:20 user devstack@n-api.service[61727]: INFO dbcounter [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Registered counter for database nova_cell0 Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG nova.context [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),557b61a6-7c46-4750-bdf8-90d5a8f88bb1(cell1) {{(pid=61729) load_cells /opt/stack/nova/nova/context.py:464}} Apr 17 19:13:20 user devstack@n-api.service[61727]: INFO dbcounter [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Registered counter for database nova_cell1 Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61729]: INFO dbcounter [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Registered counter for database nova_cell0 Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61729]: INFO dbcounter [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Registered counter for database nova_cell1 Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_db.sqlalchemy.engines [None req-97e32799-7b34-4348-90a7-44164b409060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61729) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writer thread running {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_db.sqlalchemy.engines [None req-97e32799-7b34-4348-90a7-44164b409060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61729) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG nova.context [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),557b61a6-7c46-4750-bdf8-90d5a8f88bb1(cell1) {{(pid=61728) load_cells /opt/stack/nova/nova/context.py:464}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:13:20 user devstack@n-api.service[61728]: INFO dbcounter [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Registered counter for database nova_cell0 Apr 17 19:13:20 user devstack@n-api.service[61728]: INFO dbcounter [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Registered counter for database nova_cell1 Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61727]: INFO dbcounter [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Registered counter for database nova_cell0 Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writer thread running {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61729]: INFO dbcounter [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Registered counter for database nova_cell0 Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG oslo_db.sqlalchemy.engines [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61727) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writer thread running {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG oslo_db.sqlalchemy.engines [None req-97e32799-7b34-4348-90a7-44164b409060 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61729) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writer thread running {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:20 user devstack@n-api.service[61728]: INFO dbcounter [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Registered counter for database nova_cell0 Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG oslo_db.sqlalchemy.engines [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61728) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 17 19:13:20 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writer thread running {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 17 19:13:21 user devstack@n-api.service[61729]: WARNING keystonemiddleware.auth_token [None req-97e32799-7b34-4348-90a7-44164b409060 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 19:13:21 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 19:13:21 user devstack@n-api.service[61729]: WARNING keystonemiddleware.auth_token [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 19:13:21 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 19:13:21 user devstack@n-api.service[61729]: WARNING keystonemiddleware.auth_token [None req-97e32799-7b34-4348-90a7-44164b409060 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 19:13:21 user devstack@n-api.service[61729]: WARNING keystonemiddleware.auth_token [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 19:13:21 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 19:13:21 user devstack@n-api.service[61729]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b5837d9990 pid: 61729 (default app) Apr 17 19:13:21 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:13:21 user devstack@n-api.service[61727]: WARNING keystonemiddleware.auth_token [None req-d9d3a79a-b391-48f9-b760-91b64ec1bc46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 19:13:21 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-97e32799-7b34-4348-90a7-44164b409060 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001503 Apr 17 19:13:21 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Mon Apr 17 19:13:21 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:13:21 user devstack@n-api.service[61727]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b5837d9990 pid: 61727 (default app) Apr 17 19:13:21 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 19:13:21 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 19:13:21 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 17 19:13:21 user devstack@n-api.service[61728]: WARNING keystonemiddleware.auth_token [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 17 19:13:21 user devstack@n-api.service[61728]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b5837d9990 pid: 61728 (default app) Apr 17 19:15:28 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-97e32799-7b34-4348-90a7-44164b409060 None None] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:28 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-97e32799-7b34-4348-90a7-44164b409060 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001802 Apr 17 19:15:28 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:28 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:28 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:28 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:28 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:28 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-faa60481-089c-41d3-8f32-3d23254511b2 admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-faa60481-089c-41d3-8f32-3d23254511b2 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.367298 Apr 17 19:15:28 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Mon Apr 17 19:15:28 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:30 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:30 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002082 Apr 17 19:15:30 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:30 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:30 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=3 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:30 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=3 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:30 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=3 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:30 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:31 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-66e7c455-1fbe-406e-9e98-adc6551e9198 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:31 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-66e7c455-1fbe-406e-9e98-adc6551e9198 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.307454 Apr 17 19:15:31 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:30 2023] POST /compute/v2.1/flavors => generated 405 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:31 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-0c65efd9-b52c-4c06-9deb-679977f62bef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-0c65efd9-b52c-4c06-9deb-679977f62bef admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044974 Apr 17 19:15:31 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 19:15:31 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:33 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:33 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001348 Apr 17 19:15:33 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:33 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-9a6f8a58-6405-4309-8625-b5f7063ba936 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "name": "ds512M", "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:33 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-9a6f8a58-6405-4309-8625-b5f7063ba936 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068816 Apr 17 19:15:33 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:33 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:33 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-420847ef-c466-4b94-94fe-9322df17bb88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-420847ef-c466-4b94-94fe-9322df17bb88 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028934 Apr 17 19:15:33 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 19:15:33 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001307 Apr 17 19:15:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:35 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:35 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-7112d074-220c-471e-8744-74d2cfb9f8e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "vcpus": 1}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:35 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-7112d074-220c-471e-8744-74d2cfb9f8e7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066857 Apr 17 19:15:35 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:35 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c61d4947-aba9-42c6-a1b4-4d763f40d656 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c61d4947-aba9-42c6-a1b4-4d763f40d656 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067254 Apr 17 19:15:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 19:15:35 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001349 Apr 17 19:15:37 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:37 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:37 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-90b32eb7-b755-4084-bc0f-2578167f5c41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:37 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-90b32eb7-b755-4084-bc0f-2578167f5c41 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064533 Apr 17 19:15:37 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:37 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c6059214-3c54-402c-9e34-8a01bba76f2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c6059214-3c54-402c-9e34-8a01bba76f2a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024269 Apr 17 19:15:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 19:15:37 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:39 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:39 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001317 Apr 17 19:15:39 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:39 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-e2fed2ae-f346-46bd-bcbc-f3d7dafd07f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:39 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-e2fed2ae-f346-46bd-bcbc-f3d7dafd07f6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.059360 Apr 17 19:15:39 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:39 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:39 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:39 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027591 Apr 17 19:15:39 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Mon Apr 17 19:15:39 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:41 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:41 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4c83b58c-1c5d-4ef5-bcbb-441b815ce6af None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001328 Apr 17 19:15:41 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:41 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:41 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-ac331743-45aa-49b7-a93b-c32c9e6f7584 admin admin] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:41 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-ac331743-45aa-49b7-a93b-c32c9e6f7584 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.067756 Apr 17 19:15:41 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Mon Apr 17 19:15:41 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:15:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001480 Apr 17 19:15:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:43 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:15:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-aed54098-a24c-4288-9f9a-fff76bce9534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-aed54098-a24c-4288-9f9a-fff76bce9534 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.315175 Apr 17 19:15:43 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:43 2023] POST /compute/v2.1/flavors => generated 400 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:43 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-2a3d4700-ef0d-4203-ad7a-3d8a164a4409 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:43 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-2a3d4700-ef0d-4203-ad7a-3d8a164a4409 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045714 Apr 17 19:15:43 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 19:15:43 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:45 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001501 Apr 17 19:15:45 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:45 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:45 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3d7155e3-4617-4a97-853f-0906173a9d54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3d7155e3-4617-4a97-853f-0906173a9d54 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.057750 Apr 17 19:15:45 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:45 2023] POST /compute/v2.1/flavors => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:45 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-4eea61c8-eb45-4ac0-b15b-6c85f42e2646 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:45 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-4eea61c8-eb45-4ac0-b15b-6c85f42e2646 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085794 Apr 17 19:15:45 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 19:15:45 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001300 Apr 17 19:15:47 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:47 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-0f5a36a4-069c-47b1-a959-81002ed534c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "name": "m1.medium", "swap": 0, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-0f5a36a4-069c-47b1-a959-81002ed534c3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070504 Apr 17 19:15:47 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:47 2023] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:47 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-ca5750c1-1ece-4871-ac42-1375868acd08 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:47 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-ca5750c1-1ece-4871-ac42-1375868acd08 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048831 Apr 17 19:15:47 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 19:15:47 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:49 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:49 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001384 Apr 17 19:15:49 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:49 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3e869952-3c2f-4ecc-bfda-95f9c531285b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:49 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3e869952-3c2f-4ecc-bfda-95f9c531285b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.063569 Apr 17 19:15:49 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:49 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:49 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-1b55ffcf-a611-488f-b767-9a83c4396f98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:49 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-1b55ffcf-a611-488f-b767-9a83c4396f98 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026902 Apr 17 19:15:49 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 19:15:49 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:15:51 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:15:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001489 Apr 17 19:15:51 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Mon Apr 17 19:15:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:15:51 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-18eaa194-f968-4c24-8227-98bd00c290cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-18eaa194-f968-4c24-8227-98bd00c290cf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.056113 Apr 17 19:15:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Mon Apr 17 19:15:51 2023] POST /compute/v2.1/flavors => generated 406 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:15:51 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-61c95486-7de7-4e83-9408-60ef57ac214c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:15:51 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-61c95486-7de7-4e83-9408-60ef57ac214c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033666 Apr 17 19:15:51 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Mon Apr 17 19:15:51 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:16:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:16:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8fde5f4d-5b96-49d8-9fa5-aedd654b81ce admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001419 Apr 17 19:16:22 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 19:16:22 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:16:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:16:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.108545 Apr 17 19:16:22 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Mon Apr 17 19:16:22 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:16:54 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-61c95486-7de7-4e83-9408-60ef57ac214c admin admin] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:16:54 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-61c95486-7de7-4e83-9408-60ef57ac214c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002717 Apr 17 19:16:54 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 19:16:54 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:16:54 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:16:54 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9cc5c900-aa46-4ba8-8b97-0d0f918c3460 admin admin] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:16:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-9cc5c900-aa46-4ba8-8b97-0d0f918c3460 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068435 Apr 17 19:16:54 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Mon Apr 17 19:16:54 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:16:58 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:16:58 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001360 Apr 17 19:16:58 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 19:16:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:16:58 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:16:58 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-72c1ddbf-99e4-4f00-be25-1da7c4bad0f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "42", "rxtx_factor": 1.0, "name": "m1.nano", "swap": 0, "vcpus": 1, "disk": 1}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:16:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-72c1ddbf-99e4-4f00-be25-1da7c4bad0f0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066376 Apr 17 19:16:58 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Mon Apr 17 19:16:58 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:16:58 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-aac11940-c640-42b8-80a3-b48a4a9f8d6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:16:58 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-aac11940-c640-42b8-80a3-b48a4a9f8d6c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024902 Apr 17 19:16:58 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Mon Apr 17 19:16:58 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:17:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:17:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1677b752-388d-415c-b960-c2dd9bd86c20 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002375 Apr 17 19:17:02 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Mon Apr 17 19:17:02 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:17:02 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c7d9ad0c-2893-4ade-810a-404f2ee7aeaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 192, "id": "84", "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:17:02 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-c7d9ad0c-2893-4ade-810a-404f2ee7aeaf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077560 Apr 17 19:17:02 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Mon Apr 17 19:17:02 2023] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:17:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-eb17ba73-76d6-4cd3-849b-4b67758c1575 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:17:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-eb17ba73-76d6-4cd3-849b-4b67758c1575 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025419 Apr 17 19:17:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Mon Apr 17 19:17:02 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:19:13 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:13 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:13 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:13 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5465a98a-99da-4661-acce-e0d58f62c254 tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Action: 'create', calling method: .version_select at 0x7f84d2aa1360>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1644542068", "metadata": {"Type": "work"}}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-5465a98a-99da-4661-acce-e0d58f62c254 tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.864308 Apr 17 19:19:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 19:19:13 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 1866 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 17 19:19:15 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:15 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-dcc5a27c-3ea1-4781-86bd-c981f945284b tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Calling method '.version_select at 0x7f84d2a8f7f0>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:15 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-dcc5a27c-3ea1-4781-86bd-c981f945284b tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db" status: 200 len: 350 microversion: 2.1 time: 0.434638 Apr 17 19:19:15 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:19:15 2023] GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db => generated 350 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:16 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-0ff80b57-29bc-4915-b615-412639308f19 tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Calling method '.version_select at 0x7f84d2a77490>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-0ff80b57-29bc-4915-b615-412639308f19 tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db" status: 200 len: 350 microversion: 2.1 time: 0.283499 Apr 17 19:19:16 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:19:16 2023] GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db => generated 350 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d1ac1e5e-3b34-4ce6-af00-9d9095cd6e0b tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Calling method '.version_select at 0x7f84d29284c0>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d1ac1e5e-3b34-4ce6-af00-9d9095cd6e0b tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db" status: 202 len: 0 microversion: 2.1 time: 0.134158 Apr 17 19:19:17 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:19:16 2023] DELETE /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:19:17 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-caf35db6-de76-4887-86ab-1f2e3725ed1d tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Calling method '.version_select at 0x7f84d2927be0>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:17 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-caf35db6-de76-4887-86ab-1f2e3725ed1d tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] HTTP exception thrown: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. Apr 17 19:19:17 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-caf35db6-de76-4887-86ab-1f2e3725ed1d tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Request method failure captured: Apr 17 19:19:17 user devstack@n-api.service[61729]: request: GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db HTTP/1.1 Apr 17 19:19:17 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:19:17 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:19:17 user devstack@n-api.service[61729]: Connection: close Apr 17 19:19:17 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:19:17 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:19:17 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:19:17 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:19:17 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZuxdO-4ab7veZqjtnVgT8WK6ufExbCvI1GxgfoUN66c7KqnJBRfvr5t8F1O-Txzx9gdOrfYIWkaKMCmv_3spVNEqhIKlp1poEMPHC_nw3Uop8r5oknjPUuT7Lqis_DtfMjxhi3S4_FUNtDuLHnU7Q1WUytGqsjQj0PRhuxLA3t6aa4 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Project-Id: adf8e4d023364d0393012674466e0d86 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Project-Name: tempest-VolumesGetTestJSON-1110865719 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/adf8e4d023364d0393012674466e0d86"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/adf8e4d023364d0393012674466e0d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/adf8e4d023364d0393012674466e0d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Tenant: tempest-VolumesGetTestJSON-1110865719 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Tenant-Id: adf8e4d023364d0393012674466e0d86 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-VolumesGetTestJSON-1110865719 Apr 17 19:19:17 user devstack@n-api.service[61729]: X-User: tempest-VolumesGetTestJSON-1110865719-project-member Apr 17 19:19:17 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:19:17 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:19:17 user devstack@n-api.service[61729]: X-User-Id: f6ea2eb864ff4d7cbec94f308350a67a Apr 17 19:19:17 user devstack@n-api.service[61729]: X-User-Name: tempest-VolumesGetTestJSON-1110865719-project-member Apr 17 19:19:17 user devstack@n-api.service[61729]: method: Apr 17 19:19:17 user devstack@n-api.service[61729]: exception: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. Apr 17 19:19:17 user devstack@n-api.service[61729]: action_args: {'id': '594fb1c3-5642-472f-aa79-48c76aa0d2db'} Apr 17 19:19:17 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. (HTTP 404) (Request-ID: req-e3a7e016-5806-4722-815b-9c16de6614ac) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. Apr 17 19:19:17 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:19:17 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-caf35db6-de76-4887-86ab-1f2e3725ed1d tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] Returning 404 to user: Volume 594fb1c3-5642-472f-aa79-48c76aa0d2db could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:19:17 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-caf35db6-de76-4887-86ab-1f2e3725ed1d tempest-VolumesGetTestJSON-1110865719 tempest-VolumesGetTestJSON-1110865719-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db" status: 404 len: 109 microversion: 2.1 time: 0.036273 Apr 17 19:19:17 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:19:17 2023] GET /compute/v2.1/os-volumes/594fb1c3-5642-472f-aa79-48c76aa0d2db => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:19:32 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-241403632", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "55337e40-446f-4356-a4c2-6d5472b60340"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:32 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-80a924d7-4584-4b9b-8294-3ab641ce3f58 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Action: 'create', calling method: .version_select at 0x7f84d2928790>, body: {"keypair": {"name": "tempest-keypair-1124996392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJvVrLjftt6vkZo8s19LHR8Bn6FsjlgExAi277TlFFd6rhK95CavjypwmrAc00T4YVCBL2lhk1pDbzJXuCbYl8JRWjILRhSM1E5RQtrSRO1jm0+R7F9jq24R40Uw6J8/BA=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:32 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-80a924d7-4584-4b9b-8294-3ab641ce3f58 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Getting quotas for project 076f19fd17424fb1a54e5ef5c09ba57c. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:19:32 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-80a924d7-4584-4b9b-8294-3ab641ce3f58 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Getting quotas for user ca9ee4b6bd524e1eb0fdd95fcbbc6aba and project 076f19fd17424fb1a54e5ef5c09ba57c. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:19:32 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] validate_networks() for [('55337e40-446f-4356-a4c2-6d5472b60340', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:19:32 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-80a924d7-4584-4b9b-8294-3ab641ce3f58 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.247162 Apr 17 19:19:32 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:19:32 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:19:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-240983541", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "74af95ed-a6d8-46e7-956e-8d482f74375a"}]}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:34 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] validate_networks() for [('74af95ed-a6d8-46e7-956e-8d482f74375a', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Getting quotas for project c67b4e282821426eb45e3e90e21edc42. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Getting quotas for user c3ca940cb3c74d02888bf82aa3c31240 and project c67b4e282821426eb45e3e90e21edc42. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:19:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:19:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8571b1f2-d2a7-4f81-aa78-12e6d0794d30 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.733021 Apr 17 19:19:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:19:32 2023] POST /compute/v2.1/servers => generated 378 bytes in 2735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:19:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-10a5732b-a796-441a-9b19-7f9d6169f3d3 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-10a5732b-a796-441a-9b19-7f9d6169f3d3 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:19:35 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-10a5732b-a796-441a-9b19-7f9d6169f3d3 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca940cb3c74d02888bf82aa3c31240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b4e282821426eb45e3e90e21edc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:19:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-10a5732b-a796-441a-9b19-7f9d6169f3d3 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f" status: 200 len: 1207 microversion: 2.1 time: 0.193289 Apr 17 19:19:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:19:34 2023] GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f => generated 1207 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:19:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1607216134", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "0e304c7a-0dc3-47a8-ae43-63b902364e7a"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:35 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] validate_networks() for [('0e304c7a-0dc3-47a8-ae43-63b902364e7a', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Getting quotas for project 81b869ed530a4a77bda0e6ec61125c2c. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Getting quotas for user 82191afa221843d9ba371a0082792089 and project 81b869ed530a4a77bda0e6ec61125c2c. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:19:36 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:19:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d4b652d2-6317-4f91-a6b5-1d217b60d928 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.038032 Apr 17 19:19:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:19:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:19:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e9293b03-81f9-4c11-9b8f-f1bc62aa8b8e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:37 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e9293b03-81f9-4c11-9b8f-f1bc62aa8b8e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Getting quotas for project a6fe9dcd78d74b1fae40910e2f3c9fd4. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Getting quotas for user b0f1ec1738134ceba94442f3038fa461 and project a6fe9dcd78d74b1fae40910e2f3c9fd4. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:19:37 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:19:37 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e9293b03-81f9-4c11-9b8f-f1bc62aa8b8e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:19:37 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-60ffa75d-ab73-44de-8b1d-bb600ccf2119 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.686769 Apr 17 19:19:37 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 19/55] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:19:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 2688 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:19:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e9293b03-81f9-4c11-9b8f-f1bc62aa8b8e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1211 microversion: 2.1 time: 0.195254 Apr 17 19:19:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-667bb2ce-e928-442e-b844-a6ca0b039039 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:37 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-667bb2ce-e928-442e-b844-a6ca0b039039 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:19:37 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 19/56] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:19:37 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1211 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:19:37 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-667bb2ce-e928-442e-b844-a6ca0b039039 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f1ec1738134ceba94442f3038fa461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe9dcd78d74b1fae40910e2f3c9fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:19:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-667bb2ce-e928-442e-b844-a6ca0b039039 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001" status: 200 len: 1208 microversion: 2.1 time: 0.255797 Apr 17 19:19:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:19:37 2023] GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001 => generated 1208 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:19:38 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1724108408", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "a10a625d-4903-4b9d-9ab4-0298e520bebe"}], "security_groups": [{"name": "tempest-securitygroup--1306121754"}], "key_name": "tempest-keypair-1124996392", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:38 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] validate_networks() for [('a10a625d-4903-4b9d-9ab4-0298e520bebe', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Getting quotas for project 076f19fd17424fb1a54e5ef5c09ba57c. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Getting quotas for user ca9ee4b6bd524e1eb0fdd95fcbbc6aba and project 076f19fd17424fb1a54e5ef5c09ba57c. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:19:40 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:19:40 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-aea14ca0-a24a-46cd-887d-09886f22e662 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.177133 Apr 17 19:19:40 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 20/58] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:19:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:19:40 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3552f78f-c2d9-4d7e-8a30-851dc48d8e83 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:19:40 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3552f78f-c2d9-4d7e-8a30-851dc48d8e83 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:19:40 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3552f78f-c2d9-4d7e-8a30-851dc48d8e83 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9ee4b6bd524e1eb0fdd95fcbbc6aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076f19fd17424fb1a54e5ef5c09ba57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:19:40 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3552f78f-c2d9-4d7e-8a30-851dc48d8e83 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 200 len: 1240 microversion: 2.1 time: 0.112605 Apr 17 19:19:40 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 20/59] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:19:40 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0d67a3-830c-48cb-b013-6cc26d033001", "tag": "cd30e204-93f5-4760-aa97-f8856224d60c"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Creating event network-changed:cd30e204-93f5-4760-aa97-f8856224d60c for instance ef0d67a3-830c-48cb-b013-6cc26d033001 on user Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61727) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-15124069-af85-4865-9355-4cc73ef6af59 req-b5d40fae-4c2d-4298-a9ee-7d605ef393be service nova] Acquired lock "compute-rpcapi-router" {{(pid=61727) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:43 user devstack@n-api.service[61727]: INFO nova.compute.rpcapi [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 17 19:19:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] Releasing lock "compute-rpcapi-router" {{(pid=61727) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 19:19:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-9087330b-64c9-4406-b6ed-4fa410c0c83a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143827 Apr 17 19:19:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 20/60] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de57ac54-e4d0-4d8c-89a7-af9af02af551", "tag": "8f76ff77-7965-42e0-a9a9-b41fcbc01b5a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:44 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Creating event network-changed:8f76ff77-7965-42e0-a9a9-b41fcbc01b5a for instance de57ac54-e4d0-4d8c-89a7-af9af02af551 on user Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61729) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e74c3523-a3a1-4ff1-972d-0c4e290e3283 req-9df18352-9ec6-406f-b0ec-b3efdb58d883 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61729) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:44 user devstack@n-api.service[61729]: INFO nova.compute.rpcapi [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 17 19:19:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] Releasing lock "compute-rpcapi-router" {{(pid=61729) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 19:19:44 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-0dda8152-400d-4156-9787-c0d6d158a101 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128977 Apr 17 19:19:44 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faeedd1b-1567-47d5-aa43-e84f7d90825f", "tag": "0c7e7832-f007-49a1-be2a-8a0fc28a9d67"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Creating event network-changed:0c7e7832-f007-49a1-be2a-8a0fc28a9d67 for instance faeedd1b-1567-47d5-aa43-e84f7d90825f on user Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61728) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4dfe6a39-3219-4568-a08b-7e2dde51d51a req-c66fc8da-268f-4190-b25b-b39a2c05f9c8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61728) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:44 user devstack@n-api.service[61728]: INFO nova.compute.rpcapi [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 17 19:19:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-86784515-b4be-4f07-897c-b718fe627184 None None] Releasing lock "compute-rpcapi-router" {{(pid=61728) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 17 19:19:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-86784515-b4be-4f07-897c-b718fe627184 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132756 Apr 17 19:19:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-298187fa-592d-49cc-9730-32eef2bb0fb5 req-18b08d4f-0a7d-40ac-b392-8536cda1b14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-298187fa-592d-49cc-9730-32eef2bb0fb5 req-18b08d4f-0a7d-40ac-b392-8536cda1b14b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-298187fa-592d-49cc-9730-32eef2bb0fb5 req-18b08d4f-0a7d-40ac-b392-8536cda1b14b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-298187fa-592d-49cc-9730-32eef2bb0fb5 req-18b08d4f-0a7d-40ac-b392-8536cda1b14b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-298187fa-592d-49cc-9730-32eef2bb0fb5 req-18b08d4f-0a7d-40ac-b392-8536cda1b14b service nova] Creating event network-changed:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:19:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-298187fa-592d-49cc-9730-32eef2bb0fb5 req-18b08d4f-0a7d-40ac-b392-8536cda1b14b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029242 Apr 17 19:19:47 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:52 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=12 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:52 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-14d12f53-1d4a-489a-8542-c8525f3184a4 req-7f3ed73b-d16e-4986-a7cc-61bbf6b17d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de57ac54-e4d0-4d8c-89a7-af9af02af551", "name": "network-vif-plugged", "status": "completed", "tag": "8f76ff77-7965-42e0-a9a9-b41fcbc01b5a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-14d12f53-1d4a-489a-8542-c8525f3184a4 req-7f3ed73b-d16e-4986-a7cc-61bbf6b17d8b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-14d12f53-1d4a-489a-8542-c8525f3184a4 req-7f3ed73b-d16e-4986-a7cc-61bbf6b17d8b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-14d12f53-1d4a-489a-8542-c8525f3184a4 req-7f3ed73b-d16e-4986-a7cc-61bbf6b17d8b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:52 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-14d12f53-1d4a-489a-8542-c8525f3184a4 req-7f3ed73b-d16e-4986-a7cc-61bbf6b17d8b service nova] Creating event network-vif-plugged:8f76ff77-7965-42e0-a9a9-b41fcbc01b5a for instance de57ac54-e4d0-4d8c-89a7-af9af02af551 on user Apr 17 19:19:52 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-14d12f53-1d4a-489a-8542-c8525f3184a4 req-7f3ed73b-d16e-4986-a7cc-61bbf6b17d8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041555 Apr 17 19:19:52 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=10 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de57ac54-e4d0-4d8c-89a7-af9af02af551", "name": "network-vif-plugged", "status": "completed", "tag": "8f76ff77-7965-42e0-a9a9-b41fcbc01b5a"}, {"server_uuid": "ef0d67a3-830c-48cb-b013-6cc26d033001", "name": "network-vif-plugged", "status": "completed", "tag": "cd30e204-93f5-4760-aa97-f8856224d60c"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] Creating event network-vif-plugged:8f76ff77-7965-42e0-a9a9-b41fcbc01b5a for instance de57ac54-e4d0-4d8c-89a7-af9af02af551 on user Apr 17 19:19:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] Creating event network-vif-plugged:cd30e204-93f5-4760-aa97-f8856224d60c for instance ef0d67a3-830c-48cb-b013-6cc26d033001 on user Apr 17 19:19:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-95022da1-e9b0-4dad-81ef-65325909e8dd req-18bca27a-170e-4630-b4f7-2e495bc81da2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044478 Apr 17 19:19:54 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 22/65] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:54 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=14 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:54 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:54 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-13bc62f5-6b82-44ef-8cee-80b42059e9d3 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Action: 'create', calling method: .version_select at 0x7f84d2037880>, body: {"keypair": {"name": "tempest-keypair-1519835356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOh5mvThVPivr3QIWjEuIbLFtSITENJbKtPNnV2GcC86pWlugvLEnNbLZaxz7ofN38oBz8x0J94GeKZ+Sr7RSMwNFEahpPmtvqABuu0XtvAmJ17M8BnME9x/c7JnuyuWQ=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:54 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-13bc62f5-6b82-44ef-8cee-80b42059e9d3 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Getting quotas for project 7b5f397ac56e44ec809668b6e0381a4f. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:19:54 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-13bc62f5-6b82-44ef-8cee-80b42059e9d3 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Getting quotas for user b012f1027c2c449e9dc82d9d3d4b2e49 and project 7b5f397ac56e44ec809668b6e0381a4f. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:19:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-13bc62f5-6b82-44ef-8cee-80b42059e9d3 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.496607 Apr 17 19:19:54 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 22/66] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:19:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0d67a3-830c-48cb-b013-6cc26d033001", "name": "network-vif-plugged", "status": "completed", "tag": "cd30e204-93f5-4760-aa97-f8856224d60c"}, {"server_uuid": "faeedd1b-1567-47d5-aa43-e84f7d90825f", "name": "network-vif-plugged", "status": "completed", "tag": "0c7e7832-f007-49a1-be2a-8a0fc28a9d67"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:56 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] Creating event network-vif-plugged:cd30e204-93f5-4760-aa97-f8856224d60c for instance ef0d67a3-830c-48cb-b013-6cc26d033001 on user Apr 17 19:19:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] Creating event network-vif-plugged:0c7e7832-f007-49a1-be2a-8a0fc28a9d67 for instance faeedd1b-1567-47d5-aa43-e84f7d90825f on user Apr 17 19:19:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-5171f99b-3637-4c99-80f1-7bf99113c6f7 req-06a24065-349d-4476-af31-9613440bc45c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069886 Apr 17 19:19:56 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 23/67] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:19:58 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-df946887-1705-41a9-9449-7be11cabe9c2 req-4de8f886-a184-4fb9-b943-1c9b9f7dabb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faeedd1b-1567-47d5-aa43-e84f7d90825f", "name": "network-vif-plugged", "status": "completed", "tag": "0c7e7832-f007-49a1-be2a-8a0fc28a9d67"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:19:58 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:19:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-df946887-1705-41a9-9449-7be11cabe9c2 req-4de8f886-a184-4fb9-b943-1c9b9f7dabb4 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:19:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-df946887-1705-41a9-9449-7be11cabe9c2 req-4de8f886-a184-4fb9-b943-1c9b9f7dabb4 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:19:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-df946887-1705-41a9-9449-7be11cabe9c2 req-4de8f886-a184-4fb9-b943-1c9b9f7dabb4 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:19:58 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-df946887-1705-41a9-9449-7be11cabe9c2 req-4de8f886-a184-4fb9-b943-1c9b9f7dabb4 service nova] Creating event network-vif-plugged:0c7e7832-f007-49a1-be2a-8a0fc28a9d67 for instance faeedd1b-1567-47d5-aa43-e84f7d90825f on user Apr 17 19:19:58 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-df946887-1705-41a9-9449-7be11cabe9c2 req-4de8f886-a184-4fb9-b943-1c9b9f7dabb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119423 Apr 17 19:19:58 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 23/68] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:00 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1305032610", "imageRef": "03c74f7a-3be9-4d2f-8641-819442eefea8", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "5515a00f-99e1-4ee3-b796-f5c015f57178"}], "security_groups": [{"name": "tempest-securitygroup--1882088979"}], "key_name": "tempest-keypair-1519835356", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:01 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] validate_networks() for [('5515a00f-99e1-4ee3-b796-f5c015f57178', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:20:01 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e272dbe4-ccb8-4ba9-acfe-dfae5f631d3a req-8d9fec60-4ffa-40fa-ac29-856ad902d4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "name": "network-vif-plugged", "status": "completed", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:01 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e272dbe4-ccb8-4ba9-acfe-dfae5f631d3a req-8d9fec60-4ffa-40fa-ac29-856ad902d4f3 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:01 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e272dbe4-ccb8-4ba9-acfe-dfae5f631d3a req-8d9fec60-4ffa-40fa-ac29-856ad902d4f3 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:01 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e272dbe4-ccb8-4ba9-acfe-dfae5f631d3a req-8d9fec60-4ffa-40fa-ac29-856ad902d4f3 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:01 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e272dbe4-ccb8-4ba9-acfe-dfae5f631d3a req-8d9fec60-4ffa-40fa-ac29-856ad902d4f3 service nova] Creating event network-vif-plugged:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:20:01 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-e272dbe4-ccb8-4ba9-acfe-dfae5f631d3a req-8d9fec60-4ffa-40fa-ac29-856ad902d4f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135345 Apr 17 19:20:01 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 24/69] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=7 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Getting quotas for project 7b5f397ac56e44ec809668b6e0381a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Getting quotas for user b012f1027c2c449e9dc82d9d3d4b2e49 and project 7b5f397ac56e44ec809668b6e0381a4f. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:20:02 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='03c74f7a-3be9-4d2f-8641-819442eefea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:20:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-dbf01171-cbba-45b7-ad11-b573813ac093 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.128474 Apr 17 19:20:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 23/70] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:20:00 2023] POST /compute/v2.1/servers => generated 404 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:20:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-9572b876-8581-4288-bec9-30867742c115 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:02 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9572b876-8581-4288-bec9-30867742c115 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:02 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-9572b876-8581-4288-bec9-30867742c115 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b012f1027c2c449e9dc82d9d3d4b2e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5f397ac56e44ec809668b6e0381a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-9572b876-8581-4288-bec9-30867742c115 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 200 len: 1240 microversion: 2.1 time: 0.206506 Apr 17 19:20:02 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:02 2023] GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 1240 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:03 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-c242ecb5-9b6e-42a5-ab39-515c9ba85da8 req-0b2ab97d-032d-4fa2-8623-82fc86e3280f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "name": "network-vif-plugged", "status": "completed", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:03 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c242ecb5-9b6e-42a5-ab39-515c9ba85da8 req-0b2ab97d-032d-4fa2-8623-82fc86e3280f service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:03 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c242ecb5-9b6e-42a5-ab39-515c9ba85da8 req-0b2ab97d-032d-4fa2-8623-82fc86e3280f service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:03 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c242ecb5-9b6e-42a5-ab39-515c9ba85da8 req-0b2ab97d-032d-4fa2-8623-82fc86e3280f service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:03 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-c242ecb5-9b6e-42a5-ab39-515c9ba85da8 req-0b2ab97d-032d-4fa2-8623-82fc86e3280f service nova] Creating event network-vif-plugged:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:20:03 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-c242ecb5-9b6e-42a5-ab39-515c9ba85da8 req-0b2ab97d-032d-4fa2-8623-82fc86e3280f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099139 Apr 17 19:20:03 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:08 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-d10d4625-fcbe-4f95-91aa-94b563959ec7 req-f4d32954-a89e-42bf-9cd0-da8352e596aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d10d4625-fcbe-4f95-91aa-94b563959ec7 req-f4d32954-a89e-42bf-9cd0-da8352e596aa service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d10d4625-fcbe-4f95-91aa-94b563959ec7 req-f4d32954-a89e-42bf-9cd0-da8352e596aa service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d10d4625-fcbe-4f95-91aa-94b563959ec7 req-f4d32954-a89e-42bf-9cd0-da8352e596aa service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:08 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-d10d4625-fcbe-4f95-91aa-94b563959ec7 req-f4d32954-a89e-42bf-9cd0-da8352e596aa service nova] Creating event network-changed:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:20:08 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-d10d4625-fcbe-4f95-91aa-94b563959ec7 req-f4d32954-a89e-42bf-9cd0-da8352e596aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042618 Apr 17 19:20:08 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:20:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-f3413eea-beda-490b-b794-5a94716cf6f7 req-42f50287-7c1e-412c-ab60-088732ec7ab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "name": "network-vif-plugged", "status": "completed", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:12 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f3413eea-beda-490b-b794-5a94716cf6f7 req-42f50287-7c1e-412c-ab60-088732ec7ab2 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f3413eea-beda-490b-b794-5a94716cf6f7 req-42f50287-7c1e-412c-ab60-088732ec7ab2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f3413eea-beda-490b-b794-5a94716cf6f7 req-42f50287-7c1e-412c-ab60-088732ec7ab2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f3413eea-beda-490b-b794-5a94716cf6f7 req-42f50287-7c1e-412c-ab60-088732ec7ab2 service nova] Creating event network-vif-plugged:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:20:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-f3413eea-beda-490b-b794-5a94716cf6f7 req-42f50287-7c1e-412c-ab60-088732ec7ab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061435 Apr 17 19:20:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 25/74] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=16 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-c1f96bfc-f304-4968-9535-8790bf7b53b2 req-2b8d9006-351f-4ada-a329-f03a85da0571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "name": "network-vif-plugged", "status": "completed", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c1f96bfc-f304-4968-9535-8790bf7b53b2 req-2b8d9006-351f-4ada-a329-f03a85da0571 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c1f96bfc-f304-4968-9535-8790bf7b53b2 req-2b8d9006-351f-4ada-a329-f03a85da0571 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c1f96bfc-f304-4968-9535-8790bf7b53b2 req-2b8d9006-351f-4ada-a329-f03a85da0571 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-c1f96bfc-f304-4968-9535-8790bf7b53b2 req-2b8d9006-351f-4ada-a329-f03a85da0571 service nova] Creating event network-vif-plugged:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:20:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-c1f96bfc-f304-4968-9535-8790bf7b53b2 req-2b8d9006-351f-4ada-a329-f03a85da0571 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068322 Apr 17 19:20:14 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 26/75] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-666dec38-cb3d-491d-8fb1-c7e7ebdd4d61 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Action: 'create', calling method: .version_select at 0x7f84d2085900>, body: {"keypair": {"name": "tempest-keypair-608121597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8i8qtsbhFyECCnrrSU0triyRN+3VBiWIlR9jtVobFfbx+rsAM5qUVZ2M4evAUoBQUJ6R1qdU1+tx9cVSRDHBViD1D88Clv2TqOkKosN0a7v/WIf6VHwjw0RplVdsE3rQ=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-666dec38-cb3d-491d-8fb1-c7e7ebdd4d61 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for project a0510183fad34a10b0c0bf6c72317faf. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:21 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-666dec38-cb3d-491d-8fb1-c7e7ebdd4d61 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for user debe1c89740d483ab7581e9cfed413a0 and project a0510183fad34a10b0c0bf6c72317faf. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-666dec38-cb3d-491d-8fb1-c7e7ebdd4d61 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.164616 Apr 17 19:20:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 25/76] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 19:20:21 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 19:20:23 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:23 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=10 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:23 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-548608169", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "77c00567-94e4-4962-806d-608af809c245"}], "security_groups": [{"name": "tempest-securitygroup--415334079"}], "key_name": "tempest-keypair-608121597", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] validate_networks() for [('77c00567-94e4-4962-806d-608af809c245', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for project a0510183fad34a10b0c0bf6c72317faf. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for user debe1c89740d483ab7581e9cfed413a0 and project a0510183fad34a10b0c0bf6c72317faf. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:20:24 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:20:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-2cea9721-ad48-4de5-8bea-f865ee2833eb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.015437 Apr 17 19:20:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 26/77] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 19:20:23 2023] POST /compute/v2.1/servers => generated 399 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 19:20:24 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:24 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:24 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-9d15167d-7dcc-4ee4-8b17-4ea8d523d158 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:24 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-9d15167d-7dcc-4ee4-8b17-4ea8d523d158 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:25 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-9d15167d-7dcc-4ee4-8b17-4ea8d523d158 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:25 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-9d15167d-7dcc-4ee4-8b17-4ea8d523d158 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:25 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-9d15167d-7dcc-4ee4-8b17-4ea8d523d158 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:25 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-9d15167d-7dcc-4ee4-8b17-4ea8d523d158 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 200 len: 1274 microversion: 2.20 time: 0.172028 Apr 17 19:20:25 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 27/78] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:20:24 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 1274 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:25 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca940cb3c74d02888bf82aa3c31240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b4e282821426eb45e3e90e21edc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-dec47468-a9a3-4f46-8ab0-6eaf29a188ae tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f" status: 200 len: 1485 microversion: 2.1 time: 0.363196 Apr 17 19:20:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:25 2023] GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f => generated 1485 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:27 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f1ec1738134ceba94442f3038fa461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe9dcd78d74b1fae40910e2f3c9fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:27 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-b0ff14df-0429-486d-bb96-c107a57e21a6 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001" status: 200 len: 1489 microversion: 2.1 time: 0.440392 Apr 17 19:20:27 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 28/80] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:27 2023] GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001 => generated 1489 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:28 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:28 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f5ce6e69-31ba-424c-b2a6-bdebaa239cc3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1493 microversion: 2.1 time: 0.828556 Apr 17 19:20:28 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 27/81] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:27 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1493 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:28 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-37b40733-2477-4f3f-bade-4320fe988c7b req-db71bcbc-df18-42ed-ae63-c06aa905085c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:28 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-37b40733-2477-4f3f-bade-4320fe988c7b req-db71bcbc-df18-42ed-ae63-c06aa905085c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:28 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-37b40733-2477-4f3f-bade-4320fe988c7b req-db71bcbc-df18-42ed-ae63-c06aa905085c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:28 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-37b40733-2477-4f3f-bade-4320fe988c7b req-db71bcbc-df18-42ed-ae63-c06aa905085c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:28 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-37b40733-2477-4f3f-bade-4320fe988c7b req-db71bcbc-df18-42ed-ae63-c06aa905085c service nova] Creating event network-changed:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:20:28 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-37b40733-2477-4f3f-bade-4320fe988c7b req-db71bcbc-df18-42ed-ae63-c06aa905085c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101275 Apr 17 19:20:28 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 29/82] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:28 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-590f6bdb-681d-4314-b57a-ec086da9b5e9 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Action: 'create', calling method: .version_select at 0x7f84d2086d40>, body: {"keypair": {"name": "tempest-keypair-1417148967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtXp8yeN6uma8/oYBoIRPj0Zo/wAKjol3E6Y/FGxG5tPDGoE2C+iHY1jnEVn9vbl6nBAzBbd2pTPNAGry7WEho9yb1VbFblBersWW8BRNa+BgVzTGhRqni5WcoalEiHBA=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:28 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-590f6bdb-681d-4314-b57a-ec086da9b5e9 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Getting quotas for project 91deb1d3c8a24418a4521ae88a754125. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:28 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-590f6bdb-681d-4314-b57a-ec086da9b5e9 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Getting quotas for user c7139a40814447f4b88dd52668ecd59d and project 91deb1d3c8a24418a4521ae88a754125. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:28 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-590f6bdb-681d-4314-b57a-ec086da9b5e9 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284661 Apr 17 19:20:28 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 27/83] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:20:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:29 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-830075267", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "22799884-d82d-4a57-90e4-1306755381a4"}], "security_groups": [{"name": "tempest-securitygroup--359644290"}], "key_name": "tempest-keypair-1417148967", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:30 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] validate_networks() for [('22799884-d82d-4a57-90e4-1306755381a4', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:30 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-c76cd2da-e89a-4a97-8982-c3cf6d75ac1a req-4b10ae98-9d30-4914-acb1-8ef330c14cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "name": "network-vif-plugged", "status": "completed", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-c76cd2da-e89a-4a97-8982-c3cf6d75ac1a req-4b10ae98-9d30-4914-acb1-8ef330c14cda service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-c76cd2da-e89a-4a97-8982-c3cf6d75ac1a req-4b10ae98-9d30-4914-acb1-8ef330c14cda service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-c76cd2da-e89a-4a97-8982-c3cf6d75ac1a req-4b10ae98-9d30-4914-acb1-8ef330c14cda service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:30 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-c76cd2da-e89a-4a97-8982-c3cf6d75ac1a req-4b10ae98-9d30-4914-acb1-8ef330c14cda service nova] Creating event network-vif-plugged:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:20:30 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-c76cd2da-e89a-4a97-8982-c3cf6d75ac1a req-4b10ae98-9d30-4914-acb1-8ef330c14cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040623 Apr 17 19:20:30 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:30 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9ee4b6bd524e1eb0fdd95fcbbc6aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076f19fd17424fb1a54e5ef5c09ba57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:30 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-a0351460-dc53-458f-b1e2-1dcb4e4faf80 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 200 len: 1555 microversion: 2.1 time: 0.245543 Apr 17 19:20:30 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 30/85] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:30 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Getting quotas for project 91deb1d3c8a24418a4521ae88a754125. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Getting quotas for user c7139a40814447f4b88dd52668ecd59d and project 91deb1d3c8a24418a4521ae88a754125. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:20:31 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:20:31 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d7912bee-f35c-4b68-bbd0-b2f94532e81f tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.290580 Apr 17 19:20:31 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 28/86] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:20:29 2023] POST /compute/v2.1/servers => generated 406 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:20:31 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a0e51a2a-388f-41b8-8938-a609bee9305d tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:31 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a0e51a2a-388f-41b8-8938-a609bee9305d tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:31 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a0e51a2a-388f-41b8-8938-a609bee9305d tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a0e51a2a-388f-41b8-8938-a609bee9305d tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1232 microversion: 2.1 time: 0.101990 Apr 17 19:20:31 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 29/87] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:31 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1232 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:32 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-00f8fa0f-e808-451e-9262-c290455c4257 req-4a73455f-5bcb-47a6-9298-0b4f1fd5c826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "name": "network-vif-plugged", "status": "completed", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-00f8fa0f-e808-451e-9262-c290455c4257 req-4a73455f-5bcb-47a6-9298-0b4f1fd5c826 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-00f8fa0f-e808-451e-9262-c290455c4257 req-4a73455f-5bcb-47a6-9298-0b4f1fd5c826 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-00f8fa0f-e808-451e-9262-c290455c4257 req-4a73455f-5bcb-47a6-9298-0b4f1fd5c826 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:32 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-00f8fa0f-e808-451e-9262-c290455c4257 req-4a73455f-5bcb-47a6-9298-0b4f1fd5c826 service nova] Creating event network-vif-plugged:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:20:32 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-00f8fa0f-e808-451e-9262-c290455c4257 req-4a73455f-5bcb-47a6-9298-0b4f1fd5c826 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035969 Apr 17 19:20:32 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 31/88] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-357da8b4-ded1-4c2a-b176-4180b9258700 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Action: 'create', calling method: .version_select at 0x7f84d2843f40>, body: {"keypair": {"name": "tempest-keypair-1775960129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqeIRgypUTW7FTVzlXPw/1h3cjzwEx+8z9UvB5Qt9g46ongOJKqPkCsKcR03N1L0ntKsN6hE6zX1Vweb7aE3GT1m0pQ7TiGCcSqKIcLpUbfNYefyo0Y/9JCf0gkbJWpwQ=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:34 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-357da8b4-ded1-4c2a-b176-4180b9258700 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Getting quotas for project f0dc0655c8314e08b62c8ae370d488cb. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:34 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-357da8b4-ded1-4c2a-b176-4180b9258700 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Getting quotas for user 9fbcd21255b546fb9a14ece87286731b and project f0dc0655c8314e08b62c8ae370d488cb. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-357da8b4-ded1-4c2a-b176-4180b9258700 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.388767 Apr 17 19:20:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 29/89] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:20:34 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-a7dbeacd-4497-4c0c-8a15-dc182e6c8f55 req-169c6515-7b90-47b5-bc54-0c43243a102e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a7dbeacd-4497-4c0c-8a15-dc182e6c8f55 req-169c6515-7b90-47b5-bc54-0c43243a102e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a7dbeacd-4497-4c0c-8a15-dc182e6c8f55 req-169c6515-7b90-47b5-bc54-0c43243a102e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a7dbeacd-4497-4c0c-8a15-dc182e6c8f55 req-169c6515-7b90-47b5-bc54-0c43243a102e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a7dbeacd-4497-4c0c-8a15-dc182e6c8f55 req-169c6515-7b90-47b5-bc54-0c43243a102e service nova] Creating event network-changed:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:20:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-a7dbeacd-4497-4c0c-8a15-dc182e6c8f55 req-169c6515-7b90-47b5-bc54-0c43243a102e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035378 Apr 17 19:20:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 30/90] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1244285815", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "994f43df-c7b8-4c55-9a39-98ed8d4eef96"}], "security_groups": [{"name": "tempest-securitygroup--255789732"}], "key_name": "tempest-keypair-1775960129", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] validate_networks() for [('994f43df-c7b8-4c55-9a39-98ed8d4eef96', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Getting quotas for project f0dc0655c8314e08b62c8ae370d488cb. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Getting quotas for user 9fbcd21255b546fb9a14ece87286731b and project f0dc0655c8314e08b62c8ae370d488cb. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:20:36 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:20:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-ae7a0fa7-4e19-4549-8637-1388b6fe4040 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.692101 Apr 17 19:20:37 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 32/91] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:20:36 2023] POST /compute/v2.1/servers => generated 403 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:20:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-db9a8083-6695-4658-ada1-8e1cd01dc480 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:37 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-db9a8083-6695-4658-ada1-8e1cd01dc480 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:37 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-db9a8083-6695-4658-ada1-8e1cd01dc480 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd21255b546fb9a14ece87286731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0dc0655c8314e08b62c8ae370d488cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-db9a8083-6695-4658-ada1-8e1cd01dc480 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f" status: 200 len: 1236 microversion: 2.1 time: 0.190280 Apr 17 19:20:37 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:37 2023] GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f => generated 1236 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:20:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-efa34a06-4231-4a0b-9877-498e13353ec3 req-9120c8b3-d9ce-4e11-8907-9cfad601182c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "name": "network-vif-plugged", "status": "completed", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-efa34a06-4231-4a0b-9877-498e13353ec3 req-9120c8b3-d9ce-4e11-8907-9cfad601182c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-efa34a06-4231-4a0b-9877-498e13353ec3 req-9120c8b3-d9ce-4e11-8907-9cfad601182c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-efa34a06-4231-4a0b-9877-498e13353ec3 req-9120c8b3-d9ce-4e11-8907-9cfad601182c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-efa34a06-4231-4a0b-9877-498e13353ec3 req-9120c8b3-d9ce-4e11-8907-9cfad601182c service nova] Creating event network-vif-plugged:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:20:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-efa34a06-4231-4a0b-9877-498e13353ec3 req-9120c8b3-d9ce-4e11-8907-9cfad601182c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049677 Apr 17 19:20:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 31/93] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:39 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-28bf8b96-8411-424d-82a7-998947dd3280 req-e8a60940-6e41-45d4-8081-5169fc7ce467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "name": "network-vif-plugged", "status": "completed", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:39 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-28bf8b96-8411-424d-82a7-998947dd3280 req-e8a60940-6e41-45d4-8081-5169fc7ce467 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:39 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-28bf8b96-8411-424d-82a7-998947dd3280 req-e8a60940-6e41-45d4-8081-5169fc7ce467 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:39 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-28bf8b96-8411-424d-82a7-998947dd3280 req-e8a60940-6e41-45d4-8081-5169fc7ce467 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:39 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-28bf8b96-8411-424d-82a7-998947dd3280 req-e8a60940-6e41-45d4-8081-5169fc7ce467 service nova] Creating event network-vif-plugged:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:20:39 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-28bf8b96-8411-424d-82a7-998947dd3280 req-e8a60940-6e41-45d4-8081-5169fc7ce467 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029520 Apr 17 19:20:39 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 33/94] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:41 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:41 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=10 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:41 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-dd4b2a0f-2fd6-4bc0-8bf7-d119cbf65006 req-d77ead15-8608-49a7-b1e3-58adc503f128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-dd4b2a0f-2fd6-4bc0-8bf7-d119cbf65006 req-d77ead15-8608-49a7-b1e3-58adc503f128 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-dd4b2a0f-2fd6-4bc0-8bf7-d119cbf65006 req-d77ead15-8608-49a7-b1e3-58adc503f128 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-dd4b2a0f-2fd6-4bc0-8bf7-d119cbf65006 req-d77ead15-8608-49a7-b1e3-58adc503f128 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:41 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-dd4b2a0f-2fd6-4bc0-8bf7-d119cbf65006 req-d77ead15-8608-49a7-b1e3-58adc503f128 service nova] Creating event network-changed:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:20:41 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-dd4b2a0f-2fd6-4bc0-8bf7-d119cbf65006 req-d77ead15-8608-49a7-b1e3-58adc503f128 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052567 Apr 17 19:20:41 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:43 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "name": "network-vif-plugged", "status": "completed", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}, {"server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "name": "network-vif-plugged", "status": "completed", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:20:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] Creating event network-vif-plugged:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:20:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] Creating event network-vif-plugged:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:20:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-1e3aff29-9bf6-4ddb-b1f9-193c6f1aff6d req-11fe836a-f1da-4e2d-aba0-28c0a0903ddc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035167 Apr 17 19:20:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 32/96] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=20 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:20:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:20:53 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b012f1027c2c449e9dc82d9d3d4b2e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5f397ac56e44ec809668b6e0381a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:20:53 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-b91cf64c-132c-4f0f-b613-5dfa0c23c3df tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 200 len: 1551 microversion: 2.1 time: 0.258684 Apr 17 19:20:53 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 34/97] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:20:52 2023] GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 1551 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=18 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=7 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:15 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-57818505-af1c-43b2-bcd4-0cd9a2069689 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 200 len: 1585 microversion: 2.20 time: 0.242480 Apr 17 19:21:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 32/98] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:21:15 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 1585 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=14 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:21 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-efd21737-c453-4a45-92bf-71854006f020 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1538 microversion: 2.1 time: 0.250755 Apr 17 19:21:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 33/99] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:21:21 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1538 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6408eaec-86cf-4e01-9b4a-5e686c2f9666 tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f" status: 204 len: 0 microversion: 2.1 time: 0.165522 Apr 17 19:21:27 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 35/100] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:21:27 2023] DELETE /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd21255b546fb9a14ece87286731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0dc0655c8314e08b62c8ae370d488cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f9dfb337-615a-450b-b869-8e4e7e122699 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f" status: 200 len: 1544 microversion: 2.1 time: 0.604025 Apr 17 19:21:27 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 33/101] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:21:27 2023] GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f => generated 1544 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:27 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3ca940cb3c74d02888bf82aa3c31240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67b4e282821426eb45e3e90e21edc42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-54047064-504f-4d86-9cb7-23bdc82cde9f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f" status: 200 len: 1491 microversion: 2.1 time: 0.596966 Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-b7e7bb79-e0e8-4ea1-a84c-a281e214d5fb req-a72d0ac3-3652-4b4e-9cea-08e888c10694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faeedd1b-1567-47d5-aa43-e84f7d90825f", "name": "network-vif-unplugged", "status": "completed", "tag": "0c7e7832-f007-49a1-be2a-8a0fc28a9d67"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:27 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 34/102] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:21:27 2023] GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f => generated 1491 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-b7e7bb79-e0e8-4ea1-a84c-a281e214d5fb req-a72d0ac3-3652-4b4e-9cea-08e888c10694 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-b7e7bb79-e0e8-4ea1-a84c-a281e214d5fb req-a72d0ac3-3652-4b4e-9cea-08e888c10694 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:27 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-b7e7bb79-e0e8-4ea1-a84c-a281e214d5fb req-a72d0ac3-3652-4b4e-9cea-08e888c10694 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:27 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-b7e7bb79-e0e8-4ea1-a84c-a281e214d5fb req-a72d0ac3-3652-4b4e-9cea-08e888c10694 service nova] Creating event network-vif-unplugged:0c7e7832-f007-49a1-be2a-8a0fc28a9d67 for instance faeedd1b-1567-47d5-aa43-e84f7d90825f on user Apr 17 19:21:27 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-b7e7bb79-e0e8-4ea1-a84c-a281e214d5fb req-a72d0ac3-3652-4b4e-9cea-08e888c10694 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028228 Apr 17 19:21:27 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 36/103] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:28 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1301691602", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "0e304c7a-0dc3-47a8-ae43-63b902364e7a"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:28 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] validate_networks() for [('0e304c7a-0dc3-47a8-ae43-63b902364e7a', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Getting quotas for project 81b869ed530a4a77bda0e6ec61125c2c. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Getting quotas for user 82191afa221843d9ba371a0082792089 and project 81b869ed530a4a77bda0e6ec61125c2c. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:21:29 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:21:29 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-370825fe-e86d-42cf-a6b2-b619e9e6e2f3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.826177 Apr 17 19:21:29 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 34/104] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:21:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:21:29 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-524ff16f-a97f-47c4-bb5a-22962ebdd6c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:29 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-524ff16f-a97f-47c4-bb5a-22962ebdd6c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:29 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-524ff16f-a97f-47c4-bb5a-22962ebdd6c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:29 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-524ff16f-a97f-47c4-bb5a-22962ebdd6c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 200 len: 1211 microversion: 2.1 time: 0.065349 Apr 17 19:21:29 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 35/105] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:21:29 2023] GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 1211 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:29 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faeedd1b-1567-47d5-aa43-e84f7d90825f", "name": "network-vif-plugged", "status": "completed", "tag": "0c7e7832-f007-49a1-be2a-8a0fc28a9d67"}, {"server_uuid": "faeedd1b-1567-47d5-aa43-e84f7d90825f", "name": "network-vif-deleted", "tag": "0c7e7832-f007-49a1-be2a-8a0fc28a9d67"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:30 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] Creating event network-vif-plugged:0c7e7832-f007-49a1-be2a-8a0fc28a9d67 for instance faeedd1b-1567-47d5-aa43-e84f7d90825f on user Apr 17 19:21:30 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] Creating event network-vif-deleted:0c7e7832-f007-49a1-be2a-8a0fc28a9d67 for instance faeedd1b-1567-47d5-aa43-e84f7d90825f on user Apr 17 19:21:30 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-6f7a4907-5835-418b-8a69-d40f6233df57 req-5acfdce1-5fee-4ab8-a918-fc4126eea655 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042097 Apr 17 19:21:30 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 35/106] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:30 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-1d9f2c3f-918d-4e6c-8124-9f64041bf36c tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001" status: 204 len: 0 microversion: 2.1 time: 0.413667 Apr 17 19:21:30 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:21:29 2023] DELETE /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:30 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0f1ec1738134ceba94442f3038fa461', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe9dcd78d74b1fae40910e2f3c9fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:30 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-e5e1b41f-d99f-45a9-97d4-c2d69de30231 tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001" status: 200 len: 1495 microversion: 2.1 time: 0.445569 Apr 17 19:21:30 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 36/108] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:21:30 2023] GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001 => generated 1495 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:30 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:31 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4830b413-9019-4ba6-8b03-257d33fc6d68 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.263066 Apr 17 19:21:31 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 36/109] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:21:30 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac/os-interface => generated 283 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:31 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e49bbeb3-c838-4412-8b52-b0135d64a0f2 req-56171ac7-d5da-4131-b207-f4edef9be9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0d67a3-830c-48cb-b013-6cc26d033001", "name": "network-vif-deleted", "tag": "cd30e204-93f5-4760-aa97-f8856224d60c"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e49bbeb3-c838-4412-8b52-b0135d64a0f2 req-56171ac7-d5da-4131-b207-f4edef9be9d8 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e49bbeb3-c838-4412-8b52-b0135d64a0f2 req-56171ac7-d5da-4131-b207-f4edef9be9d8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e49bbeb3-c838-4412-8b52-b0135d64a0f2 req-56171ac7-d5da-4131-b207-f4edef9be9d8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:31 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e49bbeb3-c838-4412-8b52-b0135d64a0f2 req-56171ac7-d5da-4131-b207-f4edef9be9d8 service nova] Creating event network-vif-deleted:cd30e204-93f5-4760-aa97-f8856224d60c for instance ef0d67a3-830c-48cb-b013-6cc26d033001 on user Apr 17 19:21:31 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-e49bbeb3-c838-4412-8b52-b0135d64a0f2 req-56171ac7-d5da-4131-b207-f4edef9be9d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029018 Apr 17 19:21:31 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 38/110] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:32 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0d67a3-830c-48cb-b013-6cc26d033001", "name": "network-vif-unplugged", "status": "completed", "tag": "cd30e204-93f5-4760-aa97-f8856224d60c"}, {"server_uuid": "ef0d67a3-830c-48cb-b013-6cc26d033001", "name": "network-vif-plugged", "status": "completed", "tag": "cd30e204-93f5-4760-aa97-f8856224d60c"}, {"name": "network-changed", "server_uuid": "c6f3e4c7-fbbd-4072-b568-a58a0eadde7b", "tag": "bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:32 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:32 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Creating event network-vif-unplugged:cd30e204-93f5-4760-aa97-f8856224d60c for instance ef0d67a3-830c-48cb-b013-6cc26d033001 on user Apr 17 19:21:32 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Creating event network-vif-plugged:cd30e204-93f5-4760-aa97-f8856224d60c for instance ef0d67a3-830c-48cb-b013-6cc26d033001 on user Apr 17 19:21:32 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] Creating event network-changed:bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc for instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b on user Apr 17 19:21:32 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-10d41a72-8f9d-49cb-9b63-a15268743f5a req-4f69a7fc-0e74-4892-802e-1902183fe59b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.052573 Apr 17 19:21:32 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 37/111] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:32 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-fe3ebfad-4d24-4829-886f-3fb569a4492e req-250f922c-cb70-49f7-87ac-e2cab3126c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:32 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fe3ebfad-4d24-4829-886f-3fb569a4492e req-250f922c-cb70-49f7-87ac-e2cab3126c7c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:32 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fe3ebfad-4d24-4829-886f-3fb569a4492e req-250f922c-cb70-49f7-87ac-e2cab3126c7c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:32 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fe3ebfad-4d24-4829-886f-3fb569a4492e req-250f922c-cb70-49f7-87ac-e2cab3126c7c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:32 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-fe3ebfad-4d24-4829-886f-3fb569a4492e req-250f922c-cb70-49f7-87ac-e2cab3126c7c service nova] Creating event network-changed:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:21:32 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-fe3ebfad-4d24-4829-886f-3fb569a4492e req-250f922c-cb70-49f7-87ac-e2cab3126c7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039957 Apr 17 19:21:32 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 37/112] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-12153325"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:32 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:33 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-66eaf110-6b21-4c8d-b40c-20cb4499dea0 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.864175 Apr 17 19:21:33 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 39/113] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 19:21:32 2023] POST /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac/action => generated 0 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 17 19:21:33 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a41426b0-88bf-41db-bfa1-10ca6144e787 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '.version_select at 0x7f84d20853f0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a41426b0-88bf-41db-bfa1-10ca6144e787 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714" status: 200 len: 1607 microversion: 2.1 time: 0.050635 Apr 17 19:21:33 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 38/114] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 17 19:21:33 2023] GET /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714 => generated 1607 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-b9367732-27cc-4681-867a-1d429bd9310d req-3796d82c-c987-41f4-91fa-4c8179e1ebe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3e4c7-fbbd-4072-b568-a58a0eadde7b", "name": "network-vif-plugged", "status": "completed", "tag": "bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b9367732-27cc-4681-867a-1d429bd9310d req-3796d82c-c987-41f4-91fa-4c8179e1ebe9 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b9367732-27cc-4681-867a-1d429bd9310d req-3796d82c-c987-41f4-91fa-4c8179e1ebe9 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b9367732-27cc-4681-867a-1d429bd9310d req-3796d82c-c987-41f4-91fa-4c8179e1ebe9 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-b9367732-27cc-4681-867a-1d429bd9310d req-3796d82c-c987-41f4-91fa-4c8179e1ebe9 service nova] Creating event network-vif-plugged:bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc for instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b on user Apr 17 19:21:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-b9367732-27cc-4681-867a-1d429bd9310d req-3796d82c-c987-41f4-91fa-4c8179e1ebe9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029661 Apr 17 19:21:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 38/115] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-00bcb745-2973-4740-8f27-0f9a1023671b req-3f476168-0895-4674-9834-2c565dba7c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3e4c7-fbbd-4072-b568-a58a0eadde7b", "name": "network-vif-plugged", "status": "completed", "tag": "bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-00bcb745-2973-4740-8f27-0f9a1023671b req-3f476168-0895-4674-9834-2c565dba7c13 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-00bcb745-2973-4740-8f27-0f9a1023671b req-3f476168-0895-4674-9834-2c565dba7c13 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-00bcb745-2973-4740-8f27-0f9a1023671b req-3f476168-0895-4674-9834-2c565dba7c13 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-00bcb745-2973-4740-8f27-0f9a1023671b req-3f476168-0895-4674-9834-2c565dba7c13 service nova] Creating event network-vif-plugged:bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc for instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b on user Apr 17 19:21:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-00bcb745-2973-4740-8f27-0f9a1023671b req-3f476168-0895-4674-9834-2c565dba7c13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029015 Apr 17 19:21:36 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 40/116] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=20 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d9a016d6-c9d6-4853-831b-f27a1809c23e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.192990 Apr 17 19:21:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 39/117] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:21:53 2023] GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=18 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-29615b72-0ba2-4d27-a7d9-c4a169174b85 req-2fe28eca-38b1-4101-a8e7-e00b7c1a7c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-29615b72-0ba2-4d27-a7d9-c4a169174b85 req-2fe28eca-38b1-4101-a8e7-e00b7c1a7c9b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-29615b72-0ba2-4d27-a7d9-c4a169174b85 req-2fe28eca-38b1-4101-a8e7-e00b7c1a7c9b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-29615b72-0ba2-4d27-a7d9-c4a169174b85 req-2fe28eca-38b1-4101-a8e7-e00b7c1a7c9b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-29615b72-0ba2-4d27-a7d9-c4a169174b85 req-2fe28eca-38b1-4101-a8e7-e00b7c1a7c9b service nova] Creating event network-changed:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:21:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-29615b72-0ba2-4d27-a7d9-c4a169174b85 req-2fe28eca-38b1-4101-a8e7-e00b7c1a7c9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040625 Apr 17 19:21:54 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 39/118] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:56 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:21:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-d1bd0a63-be03-4163-b52d-50ab7811e62e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 204 len: 0 microversion: 2.1 time: 0.111701 Apr 17 19:21:56 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 41/119] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:21:56 2023] DELETE /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:56 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b012f1027c2c449e9dc82d9d3d4b2e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b5f397ac56e44ec809668b6e0381a4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:21:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-ad7b0bd5-957c-456d-8cf0-eadfe487a762 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 200 len: 1676 microversion: 2.1 time: 0.230875 Apr 17 19:21:56 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 40/120] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:21:56 2023] GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 1676 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:21:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-7a3036e8-4f0e-4226-9d05-bf81da569719 req-07565d62-62d4-47e4-b8da-63dad73bd88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "name": "network-vif-unplugged", "status": "completed", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7a3036e8-4f0e-4226-9d05-bf81da569719 req-07565d62-62d4-47e4-b8da-63dad73bd88f service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7a3036e8-4f0e-4226-9d05-bf81da569719 req-07565d62-62d4-47e4-b8da-63dad73bd88f service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7a3036e8-4f0e-4226-9d05-bf81da569719 req-07565d62-62d4-47e4-b8da-63dad73bd88f service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-7a3036e8-4f0e-4226-9d05-bf81da569719 req-07565d62-62d4-47e4-b8da-63dad73bd88f service nova] Creating event network-vif-unplugged:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:21:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-7a3036e8-4f0e-4226-9d05-bf81da569719 req-07565d62-62d4-47e4-b8da-63dad73bd88f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034879 Apr 17 19:21:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 40/121] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:21:58 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "name": "network-vif-plugged", "status": "completed", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}, {"server_uuid": "8d206c83-839b-4ab2-bfdc-5e063221e50a", "name": "network-vif-deleted", "tag": "60ed8fd9-c453-48f8-85fa-7df52610c51a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:21:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:21:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:21:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:21:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] Creating event network-vif-plugged:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:21:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] Creating event network-vif-deleted:60ed8fd9-c453-48f8-85fa-7df52610c51a for instance 8d206c83-839b-4ab2-bfdc-5e063221e50a on user Apr 17 19:21:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-eae3538c-1640-4c5e-964f-ae67ac607944 req-b13217cf-949e-49c6-a63a-584f26b98021 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031112 Apr 17 19:21:58 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 42/122] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:21:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-7fc14e56-ea60-4a87-b729-5b3b1233605e tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.160863 Apr 17 19:22:15 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 41/123] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 19:22:15 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:22:16 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:16 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-26c53f4b-a111-4c67-aeea-dac2a0b9f975 req-5fb2bb5b-303b-4a5a-b3d5-e12360fe28c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-26c53f4b-a111-4c67-aeea-dac2a0b9f975 req-5fb2bb5b-303b-4a5a-b3d5-e12360fe28c7 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-26c53f4b-a111-4c67-aeea-dac2a0b9f975 req-5fb2bb5b-303b-4a5a-b3d5-e12360fe28c7 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-26c53f4b-a111-4c67-aeea-dac2a0b9f975 req-5fb2bb5b-303b-4a5a-b3d5-e12360fe28c7 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-26c53f4b-a111-4c67-aeea-dac2a0b9f975 req-5fb2bb5b-303b-4a5a-b3d5-e12360fe28c7 service nova] Creating event network-changed:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:22:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-26c53f4b-a111-4c67-aeea-dac2a0b9f975 req-5fb2bb5b-303b-4a5a-b3d5-e12360fe28c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061050 Apr 17 19:22:16 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 41/124] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-4aed8af5-189c-4853-9d0b-9e52d0b384d4 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de/ips" status: 200 len: 110 microversion: 2.20 time: 0.048266 Apr 17 19:22:16 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 43/125] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Apr 17 19:22:16 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de/ips => generated 110 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:22:17 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:17 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] [instance: faeedd1b-1567-47d5-aa43-e84f7d90825f] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] HTTP exception thrown: Instance faeedd1b-1567-47d5-aa43-e84f7d90825f could not be found. Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Request method failure captured: Apr 17 19:22:18 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f HTTP/1.1 Apr 17 19:22:18 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:22:18 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:22:18 user devstack@n-api.service[61727]: Connection: close Apr 17 19:22:18 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:22:18 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:22:18 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:22:18 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:22:18 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZu-v9E2BQf9LfEzW90qqTHFFhi4xQCnliGODom8uDWkU1knkH88b5xijIOerDwBySbybqi8LlSmPLFn5o6Md8VFOrcFPE0qL9xKsrDkmPuC3tCdhuWDNRUfep0kNxqIHYHyXS54EZUHqsuLn2SBdkiUGOtX6JavrdTQy4wJmk_5W6g Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Project-Id: c67b4e282821426eb45e3e90e21edc42 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Project-Name: tempest-VolumesActionsTest-4563664 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c67b4e282821426eb45e3e90e21edc42"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c67b4e282821426eb45e3e90e21edc42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c67b4e282821426eb45e3e90e21edc42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Tenant: tempest-VolumesActionsTest-4563664 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Tenant-Id: c67b4e282821426eb45e3e90e21edc42 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-VolumesActionsTest-4563664 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-User: tempest-VolumesActionsTest-4563664-project-member Apr 17 19:22:18 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:22:18 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:22:18 user devstack@n-api.service[61727]: X-User-Id: c3ca940cb3c74d02888bf82aa3c31240 Apr 17 19:22:18 user devstack@n-api.service[61727]: X-User-Name: tempest-VolumesActionsTest-4563664-project-member Apr 17 19:22:18 user devstack@n-api.service[61727]: method: > Apr 17 19:22:18 user devstack@n-api.service[61727]: exception: Instance faeedd1b-1567-47d5-aa43-e84f7d90825f could not be found. Apr 17 19:22:18 user devstack@n-api.service[61727]: action_args: {'id': 'faeedd1b-1567-47d5-aa43-e84f7d90825f'} Apr 17 19:22:18 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faeedd1b-1567-47d5-aa43-e84f7d90825f could not be found. Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faeedd1b-1567-47d5-aa43-e84f7d90825f could not be found. Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faeedd1b-1567-47d5-aa43-e84f7d90825f could not be found. Apr 17 19:22:18 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] Returning 404 to user: Instance faeedd1b-1567-47d5-aa43-e84f7d90825f could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:22:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-32f06c3d-06a9-46bb-8858-3aabf3892f5f tempest-VolumesActionsTest-4563664 tempest-VolumesActionsTest-4563664-project-member] 10.0.0.210 "GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f" status: 404 len: 111 microversion: 2.1 time: 0.033675 Apr 17 19:22:18 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 42/126] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:17 2023] GET /compute/v2.1/servers/faeedd1b-1567-47d5-aa43-e84f7d90825f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:22:18 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:22:18 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e6ae7422-c0b7-41e5-93a0-563d707539c0 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 204 len: 0 microversion: 2.20 time: 0.137659 Apr 17 19:22:18 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 42/127] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:22:17 2023] DELETE /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-2f6254e6-0608-41d9-8230-0f89ddc5ef3c req-b5d58c3a-99a2-4be1-b6ea-9fc0c63a9e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "name": "network-vif-unplugged", "status": "completed", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2f6254e6-0608-41d9-8230-0f89ddc5ef3c req-b5d58c3a-99a2-4be1-b6ea-9fc0c63a9e75 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2f6254e6-0608-41d9-8230-0f89ddc5ef3c req-b5d58c3a-99a2-4be1-b6ea-9fc0c63a9e75 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2f6254e6-0608-41d9-8230-0f89ddc5ef3c req-b5d58c3a-99a2-4be1-b6ea-9fc0c63a9e75 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-2f6254e6-0608-41d9-8230-0f89ddc5ef3c req-b5d58c3a-99a2-4be1-b6ea-9fc0c63a9e75 service nova] Creating event network-vif-unplugged:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:18 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:18 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-690e7cf4-8558-4289-9136-712f232ac16d tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 200 len: 1709 microversion: 2.20 time: 0.276085 Apr 17 19:22:18 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 44/128] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:22:18 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 1709 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:22:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-2f6254e6-0608-41d9-8230-0f89ddc5ef3c req-b5d58c3a-99a2-4be1-b6ea-9fc0c63a9e75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037293 Apr 17 19:22:18 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 43/129] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:19 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:19 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3fd9c95b-b89c-46bc-96ab-89892bc27856 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 200 len: 1493 microversion: 2.1 time: 0.359680 Apr 17 19:22:19 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 43/130] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:19 2023] GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 1493 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:19 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-a2a3a51b-9e67-4752-b2c6-f9b12cae9d47 req-8d8351bf-3496-47a3-a518-3f28c8c7bf54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "name": "network-vif-deleted", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a2a3a51b-9e67-4752-b2c6-f9b12cae9d47 req-8d8351bf-3496-47a3-a518-3f28c8c7bf54 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a2a3a51b-9e67-4752-b2c6-f9b12cae9d47 req-8d8351bf-3496-47a3-a518-3f28c8c7bf54 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a2a3a51b-9e67-4752-b2c6-f9b12cae9d47 req-8d8351bf-3496-47a3-a518-3f28c8c7bf54 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:19 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-a2a3a51b-9e67-4752-b2c6-f9b12cae9d47 req-8d8351bf-3496-47a3-a518-3f28c8c7bf54 service nova] Creating event network-vif-deleted:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:22:19 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-a2a3a51b-9e67-4752-b2c6-f9b12cae9d47 req-8d8351bf-3496-47a3-a518-3f28c8c7bf54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041214 Apr 17 19:22:19 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-756af25f-7791-4071-bcc6-6148c85c5aa0 req-e2078f33-bcce-4802-8f77-a4aea12c8cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff662a93-859a-46d9-9d6f-417df47860de", "name": "network-vif-plugged", "status": "completed", "tag": "3c6172f5-2788-42f2-98ae-e8abbf1a48a6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-756af25f-7791-4071-bcc6-6148c85c5aa0 req-e2078f33-bcce-4802-8f77-a4aea12c8cc4 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-756af25f-7791-4071-bcc6-6148c85c5aa0 req-e2078f33-bcce-4802-8f77-a4aea12c8cc4 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-756af25f-7791-4071-bcc6-6148c85c5aa0 req-e2078f33-bcce-4802-8f77-a4aea12c8cc4 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] [instance: ef0d67a3-830c-48cb-b013-6cc26d033001] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:20 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-756af25f-7791-4071-bcc6-6148c85c5aa0 req-e2078f33-bcce-4802-8f77-a4aea12c8cc4 service nova] Creating event network-vif-plugged:3c6172f5-2788-42f2-98ae-e8abbf1a48a6 for instance ff662a93-859a-46d9-9d6f-417df47860de on user Apr 17 19:22:20 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-756af25f-7791-4071-bcc6-6148c85c5aa0 req-e2078f33-bcce-4802-8f77-a4aea12c8cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269688 Apr 17 19:22:20 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:20 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] HTTP exception thrown: Instance ef0d67a3-830c-48cb-b013-6cc26d033001 could not be found. Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Request method failure captured: Apr 17 19:22:20 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001 HTTP/1.1 Apr 17 19:22:20 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:22:20 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:22:20 user devstack@n-api.service[61728]: Connection: close Apr 17 19:22:20 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:22:20 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:22:20 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:22:20 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:22:20 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZvGCsD7Yc8BK6Hv-e2V2Q3C0b0MWP8EueGlEv0ZUK7o7oDDXqp1Hjl5yPVAIRJN4ORVdrnsaoh6lAU8ey5kWwpKheiu5ec8rYZyv07DemlDwbcIYsjtsTfRf-hFNcn8qWhG6ISurX96-M-C8hnLqRhr92qjKNL3Jug7C6sj-C3CO2w Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Project-Id: a6fe9dcd78d74b1fae40910e2f3c9fd4 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Project-Name: tempest-DeleteServersTestJSON-1527368719 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a6fe9dcd78d74b1fae40910e2f3c9fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6fe9dcd78d74b1fae40910e2f3c9fd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a6fe9dcd78d74b1fae40910e2f3c9fd4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Tenant: tempest-DeleteServersTestJSON-1527368719 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Tenant-Id: a6fe9dcd78d74b1fae40910e2f3c9fd4 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-DeleteServersTestJSON-1527368719 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-User: tempest-DeleteServersTestJSON-1527368719-project-member Apr 17 19:22:20 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:22:20 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:22:20 user devstack@n-api.service[61728]: X-User-Id: b0f1ec1738134ceba94442f3038fa461 Apr 17 19:22:20 user devstack@n-api.service[61728]: X-User-Name: tempest-DeleteServersTestJSON-1527368719-project-member Apr 17 19:22:20 user devstack@n-api.service[61728]: method: > Apr 17 19:22:20 user devstack@n-api.service[61728]: exception: Instance ef0d67a3-830c-48cb-b013-6cc26d033001 could not be found. Apr 17 19:22:20 user devstack@n-api.service[61728]: action_args: {'id': 'ef0d67a3-830c-48cb-b013-6cc26d033001'} Apr 17 19:22:20 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0d67a3-830c-48cb-b013-6cc26d033001 could not be found. Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0d67a3-830c-48cb-b013-6cc26d033001 could not be found. Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0d67a3-830c-48cb-b013-6cc26d033001 could not be found. Apr 17 19:22:20 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:20 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] Returning 404 to user: Instance ef0d67a3-830c-48cb-b013-6cc26d033001 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:22:20 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-25961188-0c8b-4851-abbc-bf2743f7ee5e tempest-DeleteServersTestJSON-1527368719 tempest-DeleteServersTestJSON-1527368719-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001" status: 404 len: 111 microversion: 2.1 time: 0.301433 Apr 17 19:22:20 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 44/133] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:20 2023] GET /compute/v2.1/servers/ef0d67a3-830c-48cb-b013-6cc26d033001 => generated 111 bytes in 303 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:21 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-1e4ba293-d59a-496d-bdbf-f002c236f169 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.188106 Apr 17 19:22:21 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:22:21 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94/os-interface => generated 283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:22 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-05aeb984-30f8-4f0c-9f86-3e2b6659c6c7 req-c9c4c770-3f58-4fde-9a67-4067e6155cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-05aeb984-30f8-4f0c-9f86-3e2b6659c6c7 req-c9c4c770-3f58-4fde-9a67-4067e6155cda service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-05aeb984-30f8-4f0c-9f86-3e2b6659c6c7 req-c9c4c770-3f58-4fde-9a67-4067e6155cda service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-05aeb984-30f8-4f0c-9f86-3e2b6659c6c7 req-c9c4c770-3f58-4fde-9a67-4067e6155cda service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-05aeb984-30f8-4f0c-9f86-3e2b6659c6c7 req-c9c4c770-3f58-4fde-9a67-4067e6155cda service nova] Creating event network-changed:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:22:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-05aeb984-30f8-4f0c-9f86-3e2b6659c6c7 req-c9c4c770-3f58-4fde-9a67-4067e6155cda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033310 Apr 17 19:22:22 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:22:23 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4d4bce18-d1bc-4507-988a-840c7f2c68bc tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1538 microversion: 2.1 time: 0.440172 Apr 17 19:22:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 45/136] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:22 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1538 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:23 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-e14924b7-5e8d-4b3f-ae55-7365dab1a682 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1538 microversion: 2.1 time: 0.149438 Apr 17 19:22:23 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 47/137] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:23 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1538 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2d1f32c6-4de0-4551-9479-373b88bf016a tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '.version_select at 0x7f84d2843760>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-2d1f32c6-4de0-4551-9479-373b88bf016a tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714" status: 200 len: 1721 microversion: 2.1 time: 0.051525 Apr 17 19:22:23 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 17 19:22:23 2023] GET /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714 => generated 1721 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-117b02d8-55ad-4fe0-820b-e06b54fead5e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '.version_select at 0x7f84d1f4b0a0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-117b02d8-55ad-4fe0-820b-e06b54fead5e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714" status: 200 len: 1721 microversion: 2.1 time: 0.051339 Apr 17 19:22:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 46/139] 10.0.0.210 () {62 vars in 1310 bytes} [Mon Apr 17 19:22:23 2023] GET /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714 => generated 1721 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:23 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9ee4b6bd524e1eb0fdd95fcbbc6aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076f19fd17424fb1a54e5ef5c09ba57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:23 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-cfa6a0cb-51ca-42d2-b40e-7aa78bd07214 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 200 len: 1674 microversion: 2.1 time: 0.211113 Apr 17 19:22:23 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 48/140] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:23 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:28 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-172cecbf-440e-45bc-90c6-095ae467e0cc tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.163687 Apr 17 19:22:28 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:22:27 2023] GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f/os-interface => generated 282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:29 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-572f6e34-7a64-4bd4-b84b-5ce9d6644027 req-e421ddb4-95c4-49c3-b87b-9a50829aeff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:29 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-572f6e34-7a64-4bd4-b84b-5ce9d6644027 req-e421ddb4-95c4-49c3-b87b-9a50829aeff2 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:29 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-572f6e34-7a64-4bd4-b84b-5ce9d6644027 req-e421ddb4-95c4-49c3-b87b-9a50829aeff2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:29 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-572f6e34-7a64-4bd4-b84b-5ce9d6644027 req-e421ddb4-95c4-49c3-b87b-9a50829aeff2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:29 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-572f6e34-7a64-4bd4-b84b-5ce9d6644027 req-e421ddb4-95c4-49c3-b87b-9a50829aeff2 service nova] Creating event network-changed:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:22:29 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-572f6e34-7a64-4bd4-b84b-5ce9d6644027 req-e421ddb4-95c4-49c3-b87b-9a50829aeff2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040011 Apr 17 19:22:29 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 47/142] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:30 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-14965517", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "994f43df-c7b8-4c55-9a39-98ed8d4eef96"}]}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:30 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] validate_networks() for [('994f43df-c7b8-4c55-9a39-98ed8d4eef96', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Getting quotas for project f0dc0655c8314e08b62c8ae370d488cb. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Getting quotas for user 9fbcd21255b546fb9a14ece87286731b and project f0dc0655c8314e08b62c8ae370d488cb. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:22:31 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:22:31 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-2067c39a-5432-4b99-8e31-2d5678c11de5 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.581880 Apr 17 19:22:31 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 49/143] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:22:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:22:31 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-87d5b769-6fe9-4c06-9c66-c5671e7e1648 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:31 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-87d5b769-6fe9-4c06-9c66-c5671e7e1648 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:31 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-87d5b769-6fe9-4c06-9c66-c5671e7e1648 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd21255b546fb9a14ece87286731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0dc0655c8314e08b62c8ae370d488cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:22:31 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-87d5b769-6fe9-4c06-9c66-c5671e7e1648 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b" status: 200 len: 1210 microversion: 2.1 time: 0.086916 Apr 17 19:22:31 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:31 2023] GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:22:33 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-5332f594-bed8-4ca0-b99d-4d4ac1826b88 req-a5a48137-5679-41a1-89c8-277030ea6e1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf9ad12-f5f9-4292-9a7d-d9afa82e716b", "tag": "2736eaff-624c-4876-bc8b-be754aa8fcb6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5332f594-bed8-4ca0-b99d-4d4ac1826b88 req-a5a48137-5679-41a1-89c8-277030ea6e1a service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5332f594-bed8-4ca0-b99d-4d4ac1826b88 req-a5a48137-5679-41a1-89c8-277030ea6e1a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:33 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5332f594-bed8-4ca0-b99d-4d4ac1826b88 req-a5a48137-5679-41a1-89c8-277030ea6e1a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-5332f594-bed8-4ca0-b99d-4d4ac1826b88 req-a5a48137-5679-41a1-89c8-277030ea6e1a service nova] Creating event network-changed:2736eaff-624c-4876-bc8b-be754aa8fcb6 for instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b on user Apr 17 19:22:33 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-5332f594-bed8-4ca0-b99d-4d4ac1826b88 req-a5a48137-5679-41a1-89c8-277030ea6e1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034705 Apr 17 19:22:33 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 48/145] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-d39fd588-344e-40a0-a925-5a5b8cf7ec06 req-2eb73aab-0033-4d66-95d7-a45dd2148dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf9ad12-f5f9-4292-9a7d-d9afa82e716b", "name": "network-vif-plugged", "status": "completed", "tag": "2736eaff-624c-4876-bc8b-be754aa8fcb6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-d39fd588-344e-40a0-a925-5a5b8cf7ec06 req-2eb73aab-0033-4d66-95d7-a45dd2148dba service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-d39fd588-344e-40a0-a925-5a5b8cf7ec06 req-2eb73aab-0033-4d66-95d7-a45dd2148dba service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-d39fd588-344e-40a0-a925-5a5b8cf7ec06 req-2eb73aab-0033-4d66-95d7-a45dd2148dba service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-d39fd588-344e-40a0-a925-5a5b8cf7ec06 req-2eb73aab-0033-4d66-95d7-a45dd2148dba service nova] Creating event network-vif-plugged:2736eaff-624c-4876-bc8b-be754aa8fcb6 for instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b on user Apr 17 19:22:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-d39fd588-344e-40a0-a925-5a5b8cf7ec06 req-2eb73aab-0033-4d66-95d7-a45dd2148dba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Apr 17 19:22:36 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:38 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-6ecef3d1-e5ce-46f1-a2e3-c0fa35d0baa8 req-f1e01c10-29f3-43a0-995b-dd6e5078945b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf9ad12-f5f9-4292-9a7d-d9afa82e716b", "name": "network-vif-plugged", "status": "completed", "tag": "2736eaff-624c-4876-bc8b-be754aa8fcb6"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:38 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6ecef3d1-e5ce-46f1-a2e3-c0fa35d0baa8 req-f1e01c10-29f3-43a0-995b-dd6e5078945b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6ecef3d1-e5ce-46f1-a2e3-c0fa35d0baa8 req-f1e01c10-29f3-43a0-995b-dd6e5078945b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:38 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6ecef3d1-e5ce-46f1-a2e3-c0fa35d0baa8 req-f1e01c10-29f3-43a0-995b-dd6e5078945b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:38 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-6ecef3d1-e5ce-46f1-a2e3-c0fa35d0baa8 req-f1e01c10-29f3-43a0-995b-dd6e5078945b service nova] Creating event network-vif-plugged:2736eaff-624c-4876-bc8b-be754aa8fcb6 for instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b on user Apr 17 19:22:38 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-6ecef3d1-e5ce-46f1-a2e3-c0fa35d0baa8 req-f1e01c10-29f3-43a0-995b-dd6e5078945b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041382 Apr 17 19:22:38 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 49/147] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=14 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=20 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] HTTP exception thrown: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Request method failure captured: Apr 17 19:22:46 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a HTTP/1.1 Apr 17 19:22:46 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:22:46 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:22:46 user devstack@n-api.service[61727]: Connection: close Apr 17 19:22:46 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:22:46 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:22:46 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:22:46 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:22:46 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZvByKva_L51wmXdow5MF31bKcr7I7CbPjvI68V6dqC7hs_oWBdGnW2aZMhu3qokKZPTPzY-8MTDOzg8kW0aFm6lWiOChws7yMkFMOWQErXKrskxWu7IfduMgzAa5ThUxoi-gvZQtIPROXinjyECkKGBQZ5GW38e-QGwEpU5IVANxb4 Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Project-Id: 7b5f397ac56e44ec809668b6e0381a4f Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Tenant-Id: 7b5f397ac56e44ec809668b6e0381a4f Apr 17 19:22:46 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:46 user devstack@n-api.service[61727]: X-User: tempest-AttachSCSIVolumeTestJSON-434462204-project-member Apr 17 19:22:46 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:22:46 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:22:46 user devstack@n-api.service[61727]: X-User-Id: b012f1027c2c449e9dc82d9d3d4b2e49 Apr 17 19:22:46 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-434462204-project-member Apr 17 19:22:46 user devstack@n-api.service[61727]: method: > Apr 17 19:22:46 user devstack@n-api.service[61727]: exception: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:46 user devstack@n-api.service[61727]: action_args: {'id': '8d206c83-839b-4ab2-bfdc-5e063221e50a'} Apr 17 19:22:46 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:46 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Returning 404 to user: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:22:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-dad97881-adc9-44e2-9bfc-200ec3ea169e tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 404 len: 111 microversion: 2.1 time: 0.051415 Apr 17 19:22:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:46 2023] GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 17 19:22:46 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:46 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:46 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-ce49a6a3-6442-4e59-9dad-0ce514c21264 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '.version_select at 0x7f84d1f7a680>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:46 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-ce49a6a3-6442-4e59-9dad-0ce514c21264 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519835356" status: 202 len: 0 microversion: 2.1 time: 0.044896 Apr 17 19:22:46 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:22:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1519835356 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] HTTP exception thrown: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Request method failure captured: Apr 17 19:22:47 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a HTTP/1.1 Apr 17 19:22:47 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:22:47 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:22:47 user devstack@n-api.service[61728]: Connection: close Apr 17 19:22:47 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:22:47 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:22:47 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:22:47 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:22:47 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZvByKva_L51wmXdow5MF31bKcr7I7CbPjvI68V6dqC7hs_oWBdGnW2aZMhu3qokKZPTPzY-8MTDOzg8kW0aFm6lWiOChws7yMkFMOWQErXKrskxWu7IfduMgzAa5ThUxoi-gvZQtIPROXinjyECkKGBQZ5GW38e-QGwEpU5IVANxb4 Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Project-Id: 7b5f397ac56e44ec809668b6e0381a4f Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Tenant-Id: 7b5f397ac56e44ec809668b6e0381a4f Apr 17 19:22:47 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:47 user devstack@n-api.service[61728]: X-User: tempest-AttachSCSIVolumeTestJSON-434462204-project-member Apr 17 19:22:47 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:22:47 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:22:47 user devstack@n-api.service[61728]: X-User-Id: b012f1027c2c449e9dc82d9d3d4b2e49 Apr 17 19:22:47 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-434462204-project-member Apr 17 19:22:47 user devstack@n-api.service[61728]: method: > Apr 17 19:22:47 user devstack@n-api.service[61728]: exception: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61728]: action_args: {'id': '8d206c83-839b-4ab2-bfdc-5e063221e50a'} Apr 17 19:22:47 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Returning 404 to user: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:22:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-cfc7395f-88ab-416f-b1ba-921a5afa5ea8 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 404 len: 111 microversion: 2.1 time: 0.061814 Apr 17 19:22:47 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 50/150] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:22:47 2023] DELETE /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] [instance: 8d206c83-839b-4ab2-bfdc-5e063221e50a] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:22:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] HTTP exception thrown: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Request method failure captured: Apr 17 19:22:47 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a HTTP/1.1 Apr 17 19:22:47 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:22:47 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:22:47 user devstack@n-api.service[61727]: Connection: close Apr 17 19:22:47 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:22:47 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:22:47 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:22:47 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:22:47 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZvByKva_L51wmXdow5MF31bKcr7I7CbPjvI68V6dqC7hs_oWBdGnW2aZMhu3qokKZPTPzY-8MTDOzg8kW0aFm6lWiOChws7yMkFMOWQErXKrskxWu7IfduMgzAa5ThUxoi-gvZQtIPROXinjyECkKGBQZ5GW38e-QGwEpU5IVANxb4 Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Project-Id: 7b5f397ac56e44ec809668b6e0381a4f Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7b5f397ac56e44ec809668b6e0381a4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Tenant-Id: 7b5f397ac56e44ec809668b6e0381a4f Apr 17 19:22:47 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-434462204 Apr 17 19:22:47 user devstack@n-api.service[61727]: X-User: tempest-AttachSCSIVolumeTestJSON-434462204-project-member Apr 17 19:22:47 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:22:47 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:22:47 user devstack@n-api.service[61727]: X-User-Id: b012f1027c2c449e9dc82d9d3d4b2e49 Apr 17 19:22:47 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-434462204-project-member Apr 17 19:22:47 user devstack@n-api.service[61727]: method: > Apr 17 19:22:47 user devstack@n-api.service[61727]: exception: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61727]: action_args: {'id': '8d206c83-839b-4ab2-bfdc-5e063221e50a'} Apr 17 19:22:47 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. Apr 17 19:22:47 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:22:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] Returning 404 to user: Instance 8d206c83-839b-4ab2-bfdc-5e063221e50a could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:22:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-cd4db149-674b-4660-8381-7b5a6adfc895 tempest-AttachSCSIVolumeTestJSON-434462204 tempest-AttachSCSIVolumeTestJSON-434462204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a" status: 404 len: 111 microversion: 2.1 time: 0.032138 Apr 17 19:22:47 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:22:47 2023] GET /compute/v2.1/servers/8d206c83-839b-4ab2-bfdc-5e063221e50a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:22:47 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=32 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:48 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6308d422-d117-4d67-a838-c3c8c844a5c0 tempest-TestStampPattern-968738838 tempest-TestStampPattern-968738838-project-member] Action: 'create', calling method: .version_select at 0x7f84d1f78af0>, body: {"keypair": {"name": "tempest-TestStampPattern-1555526925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJVxvwG8hMxyUM2o4wFxLu6zNyDULSggguq9ivxsMpSdZ0zm0QewN93b41ZsG0zuVZxstVHPpsRQPI1eRZ1mIQavcCgemp0zDq6UIdb7FUvGHUxnYqGyhtPsmcEuPek8Q=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:22:48 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:22:48 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-6308d422-d117-4d67-a838-c3c8c844a5c0 tempest-TestStampPattern-968738838 tempest-TestStampPattern-968738838-project-member] Getting quotas for project 23792baae9ce4b648dd0bfcf1f17cfa0. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:22:48 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-6308d422-d117-4d67-a838-c3c8c844a5c0 tempest-TestStampPattern-968738838 tempest-TestStampPattern-968738838-project-member] Getting quotas for user 0c4925dded074c03adae30b911cc7571 and project 23792baae9ce4b648dd0bfcf1f17cfa0. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:22:48 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6308d422-d117-4d67-a838-c3c8c844a5c0 tempest-TestStampPattern-968738838 tempest-TestStampPattern-968738838-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.269073 Apr 17 19:22:48 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 52/152] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:22:47 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:22:51 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-88cb99d0-6ecb-4d85-bd25-cbc6edcf067f tempest-TestStampPattern-968738838 tempest-TestStampPattern-968738838-project-member] Calling method '.version_select at 0x7f84d1f0f490>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:22:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-88cb99d0-6ecb-4d85-bd25-cbc6edcf067f tempest-TestStampPattern-968738838 tempest-TestStampPattern-968738838-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1555526925" status: 202 len: 0 microversion: 2.1 time: 0.027365 Apr 17 19:22:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:22:51 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1555526925 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:23:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-05939603-4c6b-4a90-b7e0-66e882ce3cee tempest-TestShelveInstance-1018280450 tempest-TestShelveInstance-1018280450-project-member] Action: 'create', calling method: .version_select at 0x7f84d1f497e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1732882394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1xi9oEKeULtp+ImxXiVuWUFyZzqJLKo/whICiU3O0hNxm65mhdrpltHWiSsI8U19VYe12lX993Fw+rljX9vhsiJTETwWEa94RpPlNog0LHgNICNuTQpRJ7WXTIFyDAbg=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:01 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-05939603-4c6b-4a90-b7e0-66e882ce3cee tempest-TestShelveInstance-1018280450 tempest-TestShelveInstance-1018280450-project-member] Getting quotas for project 1dc474f11a8b4ed28d1ec58322eb8a6e. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:23:01 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-05939603-4c6b-4a90-b7e0-66e882ce3cee tempest-TestShelveInstance-1018280450 tempest-TestShelveInstance-1018280450-project-member] Getting quotas for user 6cc88d0a530149ae8c4c34f0540f9e46 and project 1dc474f11a8b4ed28d1ec58322eb8a6e. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:23:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-05939603-4c6b-4a90-b7e0-66e882ce3cee tempest-TestShelveInstance-1018280450 tempest-TestShelveInstance-1018280450-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.315419 Apr 17 19:23:01 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 51/154] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:23:01 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-201186821", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "e7a6280a-93ff-4c57-8b63-ab13755c3ae2"}]}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] validate_networks() for [('e7a6280a-93ff-4c57-8b63-ab13755c3ae2', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for user 564b229ded9c40dfa3a6afc15663c832 and project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:23:04 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:23:04 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-9e02df89-f36e-4d7a-9c29-efdd59fe7418 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.593424 Apr 17 19:23:04 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 53/155] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 19:23:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f3bac897-aa87-4191-affe-7837107ecf48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f3bac897-aa87-4191-affe-7837107ecf48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-f3bac897-aa87-4191-affe-7837107ecf48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-f3bac897-aa87-4191-affe-7837107ecf48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:04 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-f3bac897-aa87-4191-affe-7837107ecf48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f3bac897-aa87-4191-affe-7837107ecf48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd" status: 200 len: 1394 microversion: 2.87 time: 0.080500 Apr 17 19:23:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 52/156] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:23:04 2023] GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd => generated 1394 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:23:05 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2510d7ec-5da0-4802-8c01-38408b8aa21e tempest-TestShelveInstance-1018280450 tempest-TestShelveInstance-1018280450-project-member] Calling method '.version_select at 0x7f84d2085d80>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2510d7ec-5da0-4802-8c01-38408b8aa21e tempest-TestShelveInstance-1018280450 tempest-TestShelveInstance-1018280450-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1732882394" status: 202 len: 0 microversion: 2.1 time: 0.022172 Apr 17 19:23:05 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1331 bytes} [Mon Apr 17 19:23:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1732882394 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:23:07 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-68330948-e9cc-49e1-b3b0-d268459d9143 req-39048a9a-3ee6-4d70-a848-dc010e99b75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b23140-b111-4d4f-87f1-f890efb1bacd", "tag": "b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:07 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-68330948-e9cc-49e1-b3b0-d268459d9143 req-39048a9a-3ee6-4d70-a848-dc010e99b75b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:07 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-68330948-e9cc-49e1-b3b0-d268459d9143 req-39048a9a-3ee6-4d70-a848-dc010e99b75b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:07 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-68330948-e9cc-49e1-b3b0-d268459d9143 req-39048a9a-3ee6-4d70-a848-dc010e99b75b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:07 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-68330948-e9cc-49e1-b3b0-d268459d9143 req-39048a9a-3ee6-4d70-a848-dc010e99b75b service nova] Creating event network-changed:b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af for instance c2b23140-b111-4d4f-87f1-f890efb1bacd on user Apr 17 19:23:07 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-68330948-e9cc-49e1-b3b0-d268459d9143 req-39048a9a-3ee6-4d70-a848-dc010e99b75b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030511 Apr 17 19:23:07 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 54/158] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] HTTP exception thrown: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Request method failure captured: Apr 17 19:23:08 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de HTTP/1.1 Apr 17 19:23:08 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:23:08 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:23:08 user devstack@n-api.service[61728]: Connection: close Apr 17 19:23:08 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:23:08 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:23:08 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:23:08 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:23:08 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZv1uhNsUeREqwI_Qjb1GpP52xgwtV4IxL6Ob2jKt133XLHBsKcEu1RIJtMN4kRCIWXfvVGL-aK_gtpXP8uWOFCu5Z95SYsa4C3kBnSXDRgz7uktqLfN7c18f7iUBEMZQfLOQhRqABVaG2dGRz6l5GIl4MMseGhqzI0shq_XUYRINF4 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Project-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Tenant-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:23:08 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:23:08 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:23:08 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:23:08 user devstack@n-api.service[61728]: X-User-Id: debe1c89740d483ab7581e9cfed413a0 Apr 17 19:23:08 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:23:08 user devstack@n-api.service[61728]: method: > Apr 17 19:23:08 user devstack@n-api.service[61728]: exception: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:23:08 user devstack@n-api.service[61728]: action_args: {'id': 'ff662a93-859a-46d9-9d6f-417df47860de'} Apr 17 19:23:08 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:23:08 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:23:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Returning 404 to user: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:23:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-5befc1c4-b324-44a1-a885-b40924272710 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 404 len: 111 microversion: 2.20 time: 0.029314 Apr 17 19:23:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 53/159] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:23:08 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:23:08 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2f6a2b78-9da7-4dd2-8e72-61c60d16d718 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '.version_select at 0x7f84d1f4b400>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:08 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2f6a2b78-9da7-4dd2-8e72-61c60d16d718 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-608121597" status: 204 len: 0 microversion: 2.20 time: 0.023011 Apr 17 19:23:08 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 53/160] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Apr 17 19:23:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-608121597 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:23:09 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-ed343cca-b441-4e77-872e-15291a0c57f9 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Action: 'create', calling method: .version_select at 0x7f84d1e07eb0>, body: {"keypair": {"name": "tempest-keypair-718452069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMawCVeVk/GtuISzTRGvoO6GOQ+7AZ8WdpkyWYNKfKu0Vy2Erin98Ty9hSc6Rj8E7prMnJJU1LeFFbDnj64pihJG9nhDWIv8FqCtNrYKF+REdCoPpS64XOYpxlt6wetcw=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:09 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-ed343cca-b441-4e77-872e-15291a0c57f9 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for project a0510183fad34a10b0c0bf6c72317faf. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:23:09 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-ed343cca-b441-4e77-872e-15291a0c57f9 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for user debe1c89740d483ab7581e9cfed413a0 and project a0510183fad34a10b0c0bf6c72317faf. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:23:09 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-ed343cca-b441-4e77-872e-15291a0c57f9 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046309 Apr 17 19:23:09 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 55/161] 10.0.0.210 () {66 vars in 1277 bytes} [Mon Apr 17 19:23:09 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 17 19:23:09 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-bd979823-861e-496f-a189-12224dd990bc req-fadbada7-1603-4094-ac30-61709302eb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b23140-b111-4d4f-87f1-f890efb1bacd", "name": "network-vif-plugged", "status": "completed", "tag": "b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-bd979823-861e-496f-a189-12224dd990bc req-fadbada7-1603-4094-ac30-61709302eb6c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-bd979823-861e-496f-a189-12224dd990bc req-fadbada7-1603-4094-ac30-61709302eb6c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-bd979823-861e-496f-a189-12224dd990bc req-fadbada7-1603-4094-ac30-61709302eb6c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:09 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-bd979823-861e-496f-a189-12224dd990bc req-fadbada7-1603-4094-ac30-61709302eb6c service nova] Creating event network-vif-plugged:b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af for instance c2b23140-b111-4d4f-87f1-f890efb1bacd on user Apr 17 19:23:09 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-bd979823-861e-496f-a189-12224dd990bc req-fadbada7-1603-4094-ac30-61709302eb6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031161 Apr 17 19:23:09 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 54/162] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-969767797", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "77c00567-94e4-4962-806d-608af809c245"}], "security_groups": [{"name": "tempest-securitygroup--489717750"}], "key_name": "tempest-keypair-718452069", "user_data": "}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] validate_networks() for [('77c00567-94e4-4962-806d-608af809c245', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:11 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-c9cc67c1-c79a-4aa1-8d91-5e85755bb895 req-e18e641a-a40d-4964-91bf-2fdbc739d2dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b23140-b111-4d4f-87f1-f890efb1bacd", "name": "network-vif-plugged", "status": "completed", "tag": "b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c9cc67c1-c79a-4aa1-8d91-5e85755bb895 req-e18e641a-a40d-4964-91bf-2fdbc739d2dd service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c9cc67c1-c79a-4aa1-8d91-5e85755bb895 req-e18e641a-a40d-4964-91bf-2fdbc739d2dd service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c9cc67c1-c79a-4aa1-8d91-5e85755bb895 req-e18e641a-a40d-4964-91bf-2fdbc739d2dd service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:23:11 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-c9cc67c1-c79a-4aa1-8d91-5e85755bb895 req-e18e641a-a40d-4964-91bf-2fdbc739d2dd service nova] Creating event network-vif-plugged:b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af for instance c2b23140-b111-4d4f-87f1-f890efb1bacd on user Apr 17 19:23:11 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-c9cc67c1-c79a-4aa1-8d91-5e85755bb895 req-e18e641a-a40d-4964-91bf-2fdbc739d2dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028062 Apr 17 19:23:11 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 56/163] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for project a0510183fad34a10b0c0bf6c72317faf. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Getting quotas for user debe1c89740d483ab7581e9cfed413a0 and project a0510183fad34a10b0c0bf6c72317faf. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:23:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:23:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-634f8c76-a504-4752-a1c9-96e43222d628 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.988739 Apr 17 19:23:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 54/164] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 19:23:10 2023] POST /compute/v2.1/servers => generated 399 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 19:23:11 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c6852907-446b-425d-b21f-83c4107eb2b3 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:11 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c6852907-446b-425d-b21f-83c4107eb2b3 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:12 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c6852907-446b-425d-b21f-83c4107eb2b3 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:12 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c6852907-446b-425d-b21f-83c4107eb2b3 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:12 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-c6852907-446b-425d-b21f-83c4107eb2b3 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c6852907-446b-425d-b21f-83c4107eb2b3 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 200 len: 1274 microversion: 2.20 time: 0.065423 Apr 17 19:23:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 55/165] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:23:11 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 1274 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:13 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:13 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-1efda70a-885a-4829-854c-af8127df2f5b tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.241995 Apr 17 19:23:13 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 57/166] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:13 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:14 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-fb495e2d-a6a0-41b8-b326-e53eebc78306 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.446208 Apr 17 19:23:14 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:13 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:23:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-10774118-8502-432e-a34c-067240c6fcb8 req-a19142c2-6371-44ee-87e6-d9f62877ee16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-10774118-8502-432e-a34c-067240c6fcb8 req-a19142c2-6371-44ee-87e6-d9f62877ee16 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-10774118-8502-432e-a34c-067240c6fcb8 req-a19142c2-6371-44ee-87e6-d9f62877ee16 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-10774118-8502-432e-a34c-067240c6fcb8 req-a19142c2-6371-44ee-87e6-d9f62877ee16 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-10774118-8502-432e-a34c-067240c6fcb8 req-a19142c2-6371-44ee-87e6-d9f62877ee16 service nova] Creating event network-changed:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:23:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-10774118-8502-432e-a34c-067240c6fcb8 req-a19142c2-6371-44ee-87e6-d9f62877ee16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030606 Apr 17 19:23:14 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 56/168] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e640a91f-8ba8-4850-a445-ff0bc0a9b242 req-5e52d17c-d540-40b5-a0c1-4dcfd3d04269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "name": "network-vif-plugged", "status": "completed", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:16 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e640a91f-8ba8-4850-a445-ff0bc0a9b242 req-5e52d17c-d540-40b5-a0c1-4dcfd3d04269 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e640a91f-8ba8-4850-a445-ff0bc0a9b242 req-5e52d17c-d540-40b5-a0c1-4dcfd3d04269 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e640a91f-8ba8-4850-a445-ff0bc0a9b242 req-5e52d17c-d540-40b5-a0c1-4dcfd3d04269 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e640a91f-8ba8-4850-a445-ff0bc0a9b242 req-5e52d17c-d540-40b5-a0c1-4dcfd3d04269 service nova] Creating event network-vif-plugged:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:23:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-e640a91f-8ba8-4850-a445-ff0bc0a9b242 req-5e52d17c-d540-40b5-a0c1-4dcfd3d04269 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 Apr 17 19:23:16 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 58/169] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-c3278faf-a0c9-469c-a628-c66fe9e1533e req-22dd8d9e-9758-486a-aba6-8bb085b96504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "name": "network-vif-plugged", "status": "completed", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-c3278faf-a0c9-469c-a628-c66fe9e1533e req-22dd8d9e-9758-486a-aba6-8bb085b96504 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-c3278faf-a0c9-469c-a628-c66fe9e1533e req-22dd8d9e-9758-486a-aba6-8bb085b96504 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-c3278faf-a0c9-469c-a628-c66fe9e1533e req-22dd8d9e-9758-486a-aba6-8bb085b96504 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-c3278faf-a0c9-469c-a628-c66fe9e1533e req-22dd8d9e-9758-486a-aba6-8bb085b96504 service nova] Creating event network-vif-plugged:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:23:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-c3278faf-a0c9-469c-a628-c66fe9e1533e req-22dd8d9e-9758-486a-aba6-8bb085b96504 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032510 Apr 17 19:23:18 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:19 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:23:19 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-2c0f20b8-1a48-44dc-be16-d78501e094b3 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 204 len: 0 microversion: 2.1 time: 0.123807 Apr 17 19:23:19 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:23:19 2023] DELETE /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=10 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:19 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:20 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:20 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-f1ca5f12-0f61-4a2f-a5f3-d1f76972b297 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 200 len: 1499 microversion: 2.1 time: 0.274175 Apr 17 19:23:20 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:19 2023] GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 1499 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:23:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3e4c7-fbbd-4072-b568-a58a0eadde7b", "name": "network-vif-unplugged", "status": "completed", "tag": "bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc"}, {"server_uuid": "c6f3e4c7-fbbd-4072-b568-a58a0eadde7b", "name": "network-vif-plugged", "status": "completed", "tag": "bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] Creating event network-vif-unplugged:bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc for instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b on user Apr 17 19:23:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] Creating event network-vif-plugged:bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc for instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b on user Apr 17 19:23:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-df9f5f85-97d3-4336-bf5e-a9dd3dbaed56 req-60c5018f-0698-4487-85f8-525082d74d47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034342 Apr 17 19:23:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:20 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:21 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd21255b546fb9a14ece87286731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0dc0655c8314e08b62c8ae370d488cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6a829285-84df-45bc-82c0-bd6ab0b90010 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b" status: 200 len: 1494 microversion: 2.1 time: 0.236187 Apr 17 19:23:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 58/174] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:21 2023] GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b => generated 1494 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 19:23:23 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-bc5df152-9f51-404f-aa25-06ca5cd612f5 req-9a51ab63-d0de-4014-95d1-72f1067fc2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6f3e4c7-fbbd-4072-b568-a58a0eadde7b", "name": "network-vif-deleted", "tag": "bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-bc5df152-9f51-404f-aa25-06ca5cd612f5 req-9a51ab63-d0de-4014-95d1-72f1067fc2f8 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-bc5df152-9f51-404f-aa25-06ca5cd612f5 req-9a51ab63-d0de-4014-95d1-72f1067fc2f8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-bc5df152-9f51-404f-aa25-06ca5cd612f5 req-9a51ab63-d0de-4014-95d1-72f1067fc2f8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:23 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-bc5df152-9f51-404f-aa25-06ca5cd612f5 req-9a51ab63-d0de-4014-95d1-72f1067fc2f8 service nova] Creating event network-vif-deleted:bc4f97f0-0a42-4b83-85d4-3bef7b7de6cc for instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b on user Apr 17 19:23:23 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-bc5df152-9f51-404f-aa25-06ca5cd612f5 req-9a51ab63-d0de-4014-95d1-72f1067fc2f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028790 Apr 17 19:23:23 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:24 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9ee4b6bd524e1eb0fdd95fcbbc6aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076f19fd17424fb1a54e5ef5c09ba57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:24 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1a379082-7ae9-41e1-b37f-fe9fd83ba312 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 200 len: 1674 microversion: 2.1 time: 0.233293 Apr 17 19:23:24 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 58/176] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:24 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 19:23:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-0b6ba9ca-92f5-40c0-ad8b-c6d5120d9b18 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '.version_select at 0x7f84d1eef010>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:26 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-0b6ba9ca-92f5-40c0-ad8b-c6d5120d9b18 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714" status: 204 len: 0 microversion: 2.1 time: 0.212257 Apr 17 19:23:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 59/177] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:26 2023] DELETE /compute/v2.1/images/d2e291af-cd67-4e35-8e54-a34603ff8714 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:26 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:23:26 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-75bec4cb-7105-45da-871b-6d470fe8c29e tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 204 len: 0 microversion: 2.1 time: 0.105200 Apr 17 19:23:26 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 61/178] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:23:26 2023] DELETE /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:26 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca9ee4b6bd524e1eb0fdd95fcbbc6aba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076f19fd17424fb1a54e5ef5c09ba57c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:26 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-6f44daf9-bc7c-4f28-9295-553b5eaf25a5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 200 len: 1680 microversion: 2.1 time: 0.267375 Apr 17 19:23:26 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:23:26 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 1680 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:23:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-4f682162-177b-4fdc-ad5e-ea354d45003c req-6592fe4a-ee26-4efc-9339-cd7b5eef6418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "name": "network-vif-unplugged", "status": "completed", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4f682162-177b-4fdc-ad5e-ea354d45003c req-6592fe4a-ee26-4efc-9339-cd7b5eef6418 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4f682162-177b-4fdc-ad5e-ea354d45003c req-6592fe4a-ee26-4efc-9339-cd7b5eef6418 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4f682162-177b-4fdc-ad5e-ea354d45003c req-6592fe4a-ee26-4efc-9339-cd7b5eef6418 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-4f682162-177b-4fdc-ad5e-ea354d45003c req-6592fe4a-ee26-4efc-9339-cd7b5eef6418 service nova] Creating event network-vif-unplugged:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:23:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-4f682162-177b-4fdc-ad5e-ea354d45003c req-6592fe4a-ee26-4efc-9339-cd7b5eef6418 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030396 Apr 17 19:23:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 60/180] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:28 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "name": "network-vif-plugged", "status": "completed", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}, {"server_uuid": "d5d558d9-c2ff-46da-a34c-4148ee30f0ac", "name": "network-vif-deleted", "tag": "d0ee6251-5910-45e4-a50d-3e62cdb1e6a3"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:23:28 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:28 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:28 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:28 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] Creating event network-vif-plugged:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:23:28 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] Creating event network-vif-deleted:d0ee6251-5910-45e4-a50d-3e62cdb1e6a3 for instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac on user Apr 17 19:23:28 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-e0d4d096-2a29-4c92-a152-b06ee9b4eb55 req-f977b9b1-f2c5-4b31-9442-585be6309477 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028268 Apr 17 19:23:28 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:23:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=24 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:55 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:23:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-536f6e62-357c-4779-adaf-3282ffb3b6ca tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd" status: 200 len: 1690 microversion: 2.87 time: 0.323228 Apr 17 19:23:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 60/182] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:23:55 2023] GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd => generated 1690 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:02 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:02 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e526414f-29b0-49d4-8388-64be10d4b905 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 200 len: 1585 microversion: 2.20 time: 0.230433 Apr 17 19:24:02 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 61/183] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:24:02 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 1585 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] HTTP exception thrown: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Request method failure captured: Apr 17 19:24:10 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b HTTP/1.1 Apr 17 19:24:10 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:24:10 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:24:10 user devstack@n-api.service[61729]: Connection: close Apr 17 19:24:10 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:24:10 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:24:10 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:24:10 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:24:10 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZvGx4lZw7BzTPxtO0iTp3eFn2_eSmj0ugKiIZCZmROgs8jgNLhHNGiKlNW5eiAh7kjy8TyIqseCT1oT_fo--oPKC8FsRXG0wTgBswjRsrYAlnV5VYwLQ6WHgq4m1SYMt6WegS3VwqvCzbUTjU6mSY13ibzp0tPd0tzqKceYelTWCNQ Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Project-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Project-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Tenant: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Tenant-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:24:10 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:24:10 user devstack@n-api.service[61729]: X-User: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:24:10 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:24:10 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:24:10 user devstack@n-api.service[61729]: X-User-Id: 82191afa221843d9ba371a0082792089 Apr 17 19:24:10 user devstack@n-api.service[61729]: X-User-Name: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:24:10 user devstack@n-api.service[61729]: method: > Apr 17 19:24:10 user devstack@n-api.service[61729]: exception: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:24:10 user devstack@n-api.service[61729]: action_args: {'id': 'c6f3e4c7-fbbd-4072-b568-a58a0eadde7b'} Apr 17 19:24:10 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:24:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Returning 404 to user: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:24:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-a1e2ba17-2fad-412e-b190-1a05e1373046 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 404 len: 111 microversion: 2.1 time: 0.041756 Apr 17 19:24:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 63/184] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:24:10 2023] GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:10 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-fb1526b0-4dab-4895-b600-0e7548d36a04 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1493 microversion: 2.1 time: 0.234325 Apr 17 19:24:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 61/185] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:24:10 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1493 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:15 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:15 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-9826d794-c7f0-4f96-8e19-67f637e7e419 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.377522 Apr 17 19:24:15 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:24:15 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] [instance: d5d558d9-c2ff-46da-a34c-4148ee30f0ac] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] HTTP exception thrown: Instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac could not be found. Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Request method failure captured: Apr 17 19:24:16 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac HTTP/1.1 Apr 17 19:24:16 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:24:16 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:24:16 user devstack@n-api.service[61729]: Connection: close Apr 17 19:24:16 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:24:16 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:24:16 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:24:16 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:24:16 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZvEc6w160ly0k8tiWB_sKpVPZRWUvcCJhmpogWFSKQ_9tqF9kHGRZTBCWaXoFjQB0v7yLU8O4IDUdJhGeJooBYiltOeX7GFNCzuOetQOKhYSQs1014ljScQG9vZzmbW5XobwhCHSFWRGioi6UU_7K3LyBmwTK3b3xSmkZhLtcAwd_U Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Project-Id: 076f19fd17424fb1a54e5ef5c09ba57c Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Project-Name: tempest-ServerStableDeviceRescueTest-619982051 Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/076f19fd17424fb1a54e5ef5c09ba57c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/076f19fd17424fb1a54e5ef5c09ba57c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/076f19fd17424fb1a54e5ef5c09ba57c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Tenant: tempest-ServerStableDeviceRescueTest-619982051 Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Tenant-Id: 076f19fd17424fb1a54e5ef5c09ba57c Apr 17 19:24:16 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-619982051 Apr 17 19:24:16 user devstack@n-api.service[61729]: X-User: tempest-ServerStableDeviceRescueTest-619982051-project-member Apr 17 19:24:16 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:24:16 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:24:16 user devstack@n-api.service[61729]: X-User-Id: ca9ee4b6bd524e1eb0fdd95fcbbc6aba Apr 17 19:24:16 user devstack@n-api.service[61729]: X-User-Name: tempest-ServerStableDeviceRescueTest-619982051-project-member Apr 17 19:24:16 user devstack@n-api.service[61729]: method: > Apr 17 19:24:16 user devstack@n-api.service[61729]: exception: Instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac could not be found. Apr 17 19:24:16 user devstack@n-api.service[61729]: action_args: {'id': 'd5d558d9-c2ff-46da-a34c-4148ee30f0ac'} Apr 17 19:24:16 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac could not be found. Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac could not be found. Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac could not be found. Apr 17 19:24:16 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:24:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Returning 404 to user: Instance d5d558d9-c2ff-46da-a34c-4148ee30f0ac could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:24:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-c51fc1b3-14aa-483c-b32d-e0ea54eb44f5 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac" status: 404 len: 111 microversion: 2.1 time: 0.032660 Apr 17 19:24:16 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 64/187] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:24:16 2023] GET /compute/v2.1/servers/d5d558d9-c2ff-46da-a34c-4148ee30f0ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:24:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3ad27812-5860-45b9-9a0f-74e4b68aa019 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] Calling method '.version_select at 0x7f84d2087520>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-3ad27812-5860-45b9-9a0f-74e4b68aa019 tempest-ServerStableDeviceRescueTest-619982051 tempest-ServerStableDeviceRescueTest-619982051-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124996392" status: 202 len: 0 microversion: 2.1 time: 0.023337 Apr 17 19:24:16 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 62/188] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:24:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1124996392 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:23 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:24:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-046c9049-0f3d-40ce-8ca9-1e4c800c7f8d tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b" status: 204 len: 0 microversion: 2.1 time: 0.115986 Apr 17 19:24:23 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:24:23 2023] DELETE /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:23 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-4839c9ef-6a57-417d-882f-4daf57402d71 req-04a98df2-8e17-4340-b9ac-6f5b3eaa2041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf9ad12-f5f9-4292-9a7d-d9afa82e716b", "name": "network-vif-unplugged", "status": "completed", "tag": "2736eaff-624c-4876-bc8b-be754aa8fcb6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4839c9ef-6a57-417d-882f-4daf57402d71 req-04a98df2-8e17-4340-b9ac-6f5b3eaa2041 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4839c9ef-6a57-417d-882f-4daf57402d71 req-04a98df2-8e17-4340-b9ac-6f5b3eaa2041 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4839c9ef-6a57-417d-882f-4daf57402d71 req-04a98df2-8e17-4340-b9ac-6f5b3eaa2041 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-4839c9ef-6a57-417d-882f-4daf57402d71 req-04a98df2-8e17-4340-b9ac-6f5b3eaa2041 service nova] Creating event network-vif-unplugged:2736eaff-624c-4876-bc8b-be754aa8fcb6 for instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b on user Apr 17 19:24:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-4839c9ef-6a57-417d-882f-4daf57402d71 req-04a98df2-8e17-4340-b9ac-6f5b3eaa2041 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031637 Apr 17 19:24:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 63/190] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:24:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:23 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd21255b546fb9a14ece87286731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0dc0655c8314e08b62c8ae370d488cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:23 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-fad27300-872a-44e1-9855-0f496c8c1835 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b" status: 200 len: 1500 microversion: 2.1 time: 0.399041 Apr 17 19:24:23 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:24:23 2023] GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b => generated 1500 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:24:24 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-45c2c7e9-ab6f-425b-a433-14ad420e1371 req-8fde73f2-0ae2-4e08-82d8-14ba66548774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf9ad12-f5f9-4292-9a7d-d9afa82e716b", "name": "network-vif-deleted", "tag": "2736eaff-624c-4876-bc8b-be754aa8fcb6"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-45c2c7e9-ab6f-425b-a433-14ad420e1371 req-8fde73f2-0ae2-4e08-82d8-14ba66548774 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-45c2c7e9-ab6f-425b-a433-14ad420e1371 req-8fde73f2-0ae2-4e08-82d8-14ba66548774 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-45c2c7e9-ab6f-425b-a433-14ad420e1371 req-8fde73f2-0ae2-4e08-82d8-14ba66548774 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-45c2c7e9-ab6f-425b-a433-14ad420e1371 req-8fde73f2-0ae2-4e08-82d8-14ba66548774 service nova] Creating event network-vif-deleted:2736eaff-624c-4876-bc8b-be754aa8fcb6 for instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b on user Apr 17 19:24:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-45c2c7e9-ab6f-425b-a433-14ad420e1371 req-8fde73f2-0ae2-4e08-82d8-14ba66548774 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054370 Apr 17 19:24:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 64/192] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:24:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:25 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-2be0c1a5-14d1-45ee-ab1a-8cc0ca9652f3 req-e29950e1-6960-4c20-8da2-e99eca1e0fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf9ad12-f5f9-4292-9a7d-d9afa82e716b", "name": "network-vif-plugged", "status": "completed", "tag": "2736eaff-624c-4876-bc8b-be754aa8fcb6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2be0c1a5-14d1-45ee-ab1a-8cc0ca9652f3 req-e29950e1-6960-4c20-8da2-e99eca1e0fa8 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2be0c1a5-14d1-45ee-ab1a-8cc0ca9652f3 req-e29950e1-6960-4c20-8da2-e99eca1e0fa8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-2be0c1a5-14d1-45ee-ab1a-8cc0ca9652f3 req-e29950e1-6960-4c20-8da2-e99eca1e0fa8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-2be0c1a5-14d1-45ee-ab1a-8cc0ca9652f3 req-e29950e1-6960-4c20-8da2-e99eca1e0fa8 service nova] Creating event network-vif-plugged:2736eaff-624c-4876-bc8b-be754aa8fcb6 for instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b on user Apr 17 19:24:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-2be0c1a5-14d1-45ee-ab1a-8cc0ca9652f3 req-e29950e1-6960-4c20-8da2-e99eca1e0fa8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029883 Apr 17 19:24:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 64/193] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:24:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:29 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-e63f79f9-63ac-4290-a6dc-d153ad0d1953 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Action: 'create', calling method: .version_select at 0x7f84d1e07250>, body: {"keypair": {"name": "tempest-keypair-223358557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNLKl180oJBArYJwkSediN4VHfxv2wFSn4uxWv+NprkdjSHZzvBI0ZVsGO8X7k9mlwQuzxf5Z9D2toby6fTEGCM/d9Nhof7CRbLP/SR9q/MTSmvlcPWEHlYqvvfejXigQ=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:29 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-e63f79f9-63ac-4290-a6dc-d153ad0d1953 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:24:29 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-e63f79f9-63ac-4290-a6dc-d153ad0d1953 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for user be6982f6dfac4e889b49f3d09b768ab9 and project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:24:29 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-e63f79f9-63ac-4290-a6dc-d153ad0d1953 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094333 Apr 17 19:24:29 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 66/194] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:24:29 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:30 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1597100669", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "063d28ee-f0b9-491c-931e-2f16c7d13e88"}], "security_groups": [{"name": "tempest-securitygroup--605835493"}], "key_name": "tempest-keypair-223358557", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:30 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] validate_networks() for [('063d28ee-f0b9-491c-931e-2f16c7d13e88', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for user be6982f6dfac4e889b49f3d09b768ab9 and project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:24:31 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:24:31 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6e8ef1fc-4b4d-42b9-976b-a66b00f9fd68 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.600382 Apr 17 19:24:31 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 65/195] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:24:30 2023] POST /compute/v2.1/servers => generated 399 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:24:31 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-7427f251-d4f9-4005-8c5e-29ec9261c1d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:24:31 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-7427f251-d4f9-4005-8c5e-29ec9261c1d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:31 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-7427f251-d4f9-4005-8c5e-29ec9261c1d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6982f6dfac4e889b49f3d09b768ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556ec6da247b4757b5f8919ad0c6f74f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:24:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-7427f251-d4f9-4005-8c5e-29ec9261c1d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 200 len: 1231 microversion: 2.1 time: 0.118218 Apr 17 19:24:31 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 65/196] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:24:31 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 1231 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:24:33 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=10 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:33 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-204b08b2-3311-4fd6-949f-dfbbf8f6ec3b req-4e98466e-fc35-4cda-8e13-d213a993e652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:33 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-204b08b2-3311-4fd6-949f-dfbbf8f6ec3b req-4e98466e-fc35-4cda-8e13-d213a993e652 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:33 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-204b08b2-3311-4fd6-949f-dfbbf8f6ec3b req-4e98466e-fc35-4cda-8e13-d213a993e652 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:33 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-204b08b2-3311-4fd6-949f-dfbbf8f6ec3b req-4e98466e-fc35-4cda-8e13-d213a993e652 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:33 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-204b08b2-3311-4fd6-949f-dfbbf8f6ec3b req-4e98466e-fc35-4cda-8e13-d213a993e652 service nova] Creating event network-changed:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:24:33 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-204b08b2-3311-4fd6-949f-dfbbf8f6ec3b req-4e98466e-fc35-4cda-8e13-d213a993e652 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030683 Apr 17 19:24:33 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 67/197] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:24:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-5826bfc8-7920-48b9-8b32-7868bca59da7 req-077d5967-4e1d-4843-a33c-70b42c7374a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "name": "network-vif-plugged", "status": "completed", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5826bfc8-7920-48b9-8b32-7868bca59da7 req-077d5967-4e1d-4843-a33c-70b42c7374a0 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5826bfc8-7920-48b9-8b32-7868bca59da7 req-077d5967-4e1d-4843-a33c-70b42c7374a0 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5826bfc8-7920-48b9-8b32-7868bca59da7 req-077d5967-4e1d-4843-a33c-70b42c7374a0 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-5826bfc8-7920-48b9-8b32-7868bca59da7 req-077d5967-4e1d-4843-a33c-70b42c7374a0 service nova] Creating event network-vif-plugged:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:24:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-5826bfc8-7920-48b9-8b32-7868bca59da7 req-077d5967-4e1d-4843-a33c-70b42c7374a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036500 Apr 17 19:24:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 66/198] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:37 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-4e444c90-36d2-4192-a86a-d2ca75e53485 req-e9332ba4-bda8-48d5-a2ad-6b417b3a707b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "name": "network-vif-plugged", "status": "completed", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:37 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4e444c90-36d2-4192-a86a-d2ca75e53485 req-e9332ba4-bda8-48d5-a2ad-6b417b3a707b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4e444c90-36d2-4192-a86a-d2ca75e53485 req-e9332ba4-bda8-48d5-a2ad-6b417b3a707b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:37 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4e444c90-36d2-4192-a86a-d2ca75e53485 req-e9332ba4-bda8-48d5-a2ad-6b417b3a707b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-4e444c90-36d2-4192-a86a-d2ca75e53485 req-e9332ba4-bda8-48d5-a2ad-6b417b3a707b service nova] Creating event network-vif-plugged:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:24:37 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-4e444c90-36d2-4192-a86a-d2ca75e53485 req-e9332ba4-bda8-48d5-a2ad-6b417b3a707b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037165 Apr 17 19:24:37 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 66/199] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-770114699"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:24:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:24:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-7d2bc444-7e8d-4c0d-9be6-9593c09e7bd1 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd/action" status: 202 len: 52 microversion: 2.87 time: 0.772581 Apr 17 19:24:56 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 68/200] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 19:24:55 2023] POST /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd/action => generated 52 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:01 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-84bfdc3c-5496-4318-be96-3cb8fb975208 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd" status: 200 len: 1690 microversion: 2.87 time: 0.283422 Apr 17 19:25:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 67/201] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:25:01 2023] GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd => generated 1690 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-fa3600ef-e1ba-4777-8b42-a49edecde4e7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.156164 Apr 17 19:25:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 67/202] 10.0.0.210 () {64 vars in 1393 bytes} [Mon Apr 17 19:25:02 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:03 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:03 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e6126ed3-c930-4fa7-87ed-d01d4455398b req-6ee21d9c-3048-45aa-b967-c3fedef0c702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:25:03 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e6126ed3-c930-4fa7-87ed-d01d4455398b req-6ee21d9c-3048-45aa-b967-c3fedef0c702 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:03 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e6126ed3-c930-4fa7-87ed-d01d4455398b req-6ee21d9c-3048-45aa-b967-c3fedef0c702 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:03 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e6126ed3-c930-4fa7-87ed-d01d4455398b req-6ee21d9c-3048-45aa-b967-c3fedef0c702 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-07e75e17-6b8b-4e18-ab77-be8184a72ab5 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66/ips" status: 200 len: 110 microversion: 2.20 time: 0.034384 Apr 17 19:25:03 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 68/203] 10.0.0.210 () {64 vars in 1366 bytes} [Mon Apr 17 19:25:03 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66/ips => generated 110 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 17 19:25:03 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e6126ed3-c930-4fa7-87ed-d01d4455398b req-6ee21d9c-3048-45aa-b967-c3fedef0c702 service nova] Creating event network-changed:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:25:03 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-e6126ed3-c930-4fa7-87ed-d01d4455398b req-6ee21d9c-3048-45aa-b967-c3fedef0c702 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098435 Apr 17 19:25:03 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 69/204] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:25:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:04 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:25:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-9b68acee-e804-4ac7-b954-fa3cf34cdb5f tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 204 len: 0 microversion: 2.20 time: 0.124631 Apr 17 19:25:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 68/205] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:25:04 2023] DELETE /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:05 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:05 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:05 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'debe1c89740d483ab7581e9cfed413a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0510183fad34a10b0c0bf6c72317faf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4ce80226-6dc8-46b6-8647-80eed1c65d17 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 200 len: 1710 microversion: 2.20 time: 0.189494 Apr 17 19:25:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 69/206] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:25:04 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 1710 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:25:05 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "name": "network-vif-unplugged", "status": "completed", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}, {"server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "name": "network-vif-plugged", "status": "completed", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:25:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:05 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] Creating event network-vif-unplugged:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:25:05 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] Creating event network-vif-plugged:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:25:05 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-89f6e0ae-4680-4ca9-abc8-85dc8e3d9de8 req-af713057-b3ee-48c7-b2b2-f2f54d11f523 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031298 Apr 17 19:25:05 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 70/207] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:25:05 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:25:07 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-127e4d11-b171-474b-8f55-75184e8e99c9 req-69b933f6-ba21-4cfc-90f9-9867c8dbbe23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66", "name": "network-vif-deleted", "tag": "1c0519f3-4603-4809-a815-3dd2a1ddc4ff"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:25:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-127e4d11-b171-474b-8f55-75184e8e99c9 req-69b933f6-ba21-4cfc-90f9-9867c8dbbe23 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-127e4d11-b171-474b-8f55-75184e8e99c9 req-69b933f6-ba21-4cfc-90f9-9867c8dbbe23 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:07 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-127e4d11-b171-474b-8f55-75184e8e99c9 req-69b933f6-ba21-4cfc-90f9-9867c8dbbe23 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-127e4d11-b171-474b-8f55-75184e8e99c9 req-69b933f6-ba21-4cfc-90f9-9867c8dbbe23 service nova] Creating event network-vif-deleted:1c0519f3-4603-4809-a815-3dd2a1ddc4ff for instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 on user Apr 17 19:25:07 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-127e4d11-b171-474b-8f55-75184e8e99c9 req-69b933f6-ba21-4cfc-90f9-9867c8dbbe23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028557 Apr 17 19:25:07 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 69/208] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:25:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:12 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-4b21ba27-bc96-4b02-bedd-d954329311c2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1493 microversion: 2.1 time: 0.229571 Apr 17 19:25:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:12 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1493 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: fdf9ad12-f5f9-4292-9a7d-d9afa82e716b] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:13 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] HTTP exception thrown: Instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b could not be found. Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Request method failure captured: Apr 17 19:25:13 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b HTTP/1.1 Apr 17 19:25:13 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:25:13 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:25:13 user devstack@n-api.service[61729]: Connection: close Apr 17 19:25:13 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:25:13 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:25:13 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:25:13 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:25:13 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZv4IxwZt3POgouRCQsLEBbHNN8BXEQ8xEOB6bn3TJGqukaXIN0oXdSdmCO2eIj1_OYUeDQs2xh_nfeAl6cM29rezUwN_8Db_DJmkgP4JGhPZa9hhYobCerGoN6bhwRJ8JIKnb9hH40i7UBYrUsiejidioNxYOCaoPj8IdI5ipTRhVg Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Project-Id: f0dc0655c8314e08b62c8ae370d488cb Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Project-Name: tempest-VolumesAdminNegativeTest-1507040722 Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0dc0655c8314e08b62c8ae370d488cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0dc0655c8314e08b62c8ae370d488cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0dc0655c8314e08b62c8ae370d488cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Tenant: tempest-VolumesAdminNegativeTest-1507040722 Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Tenant-Id: f0dc0655c8314e08b62c8ae370d488cb Apr 17 19:25:13 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1507040722 Apr 17 19:25:13 user devstack@n-api.service[61729]: X-User: tempest-VolumesAdminNegativeTest-1507040722-project-member Apr 17 19:25:13 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:25:13 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:25:13 user devstack@n-api.service[61729]: X-User-Id: 9fbcd21255b546fb9a14ece87286731b Apr 17 19:25:13 user devstack@n-api.service[61729]: X-User-Name: tempest-VolumesAdminNegativeTest-1507040722-project-member Apr 17 19:25:13 user devstack@n-api.service[61729]: method: > Apr 17 19:25:13 user devstack@n-api.service[61729]: exception: Instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b could not be found. Apr 17 19:25:13 user devstack@n-api.service[61729]: action_args: {'id': 'fdf9ad12-f5f9-4292-9a7d-d9afa82e716b'} Apr 17 19:25:13 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b could not be found. Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b could not be found. Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b could not be found. Apr 17 19:25:13 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:13 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Returning 404 to user: Instance fdf9ad12-f5f9-4292-9a7d-d9afa82e716b could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:25:13 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-b9327c64-5cf8-429f-a839-5c6529720817 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b" status: 404 len: 111 microversion: 2.1 time: 0.029369 Apr 17 19:25:13 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:13 2023] GET /compute/v2.1/servers/fdf9ad12-f5f9-4292-9a7d-d9afa82e716b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:14 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:25:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-877f9744-c7b3-4927-bc11-1be78cd2dfc0 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f" status: 204 len: 0 microversion: 2.1 time: 0.108306 Apr 17 19:25:14 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 70/211] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:25:14 2023] DELETE /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:14 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fbcd21255b546fb9a14ece87286731b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0dc0655c8314e08b62c8ae370d488cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3537fb14-30ef-4d04-8c0f-056f57bbf36c tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f" status: 200 len: 1669 microversion: 2.1 time: 0.401870 Apr 17 19:25:14 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:14 2023] GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f => generated 1669 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:25:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-a4baaa36-63e6-42ba-8118-842a6aedc014 req-a9dfea92-cea2-4800-9740-59c9c46ee69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "name": "network-vif-unplugged", "status": "completed", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:25:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a4baaa36-63e6-42ba-8118-842a6aedc014 req-a9dfea92-cea2-4800-9740-59c9c46ee69f service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a4baaa36-63e6-42ba-8118-842a6aedc014 req-a9dfea92-cea2-4800-9740-59c9c46ee69f service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a4baaa36-63e6-42ba-8118-842a6aedc014 req-a9dfea92-cea2-4800-9740-59c9c46ee69f service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-a4baaa36-63e6-42ba-8118-842a6aedc014 req-a9dfea92-cea2-4800-9740-59c9c46ee69f service nova] Creating event network-vif-unplugged:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:25:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-a4baaa36-63e6-42ba-8118-842a6aedc014 req-a9dfea92-cea2-4800-9740-59c9c46ee69f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033606 Apr 17 19:25:14 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 72/213] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:16 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c95e28d9-4d4c-4fe8-af9b-6452d81578b8 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.243473 Apr 17 19:25:16 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:15 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:16 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3752cc5a-64a7-4b10-9a4c-3b365666aaa4 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.136703 Apr 17 19:25:16 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:16 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:16 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-d34b2eb4-f70c-4e69-9524-08864b0346bb tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.243515 Apr 17 19:25:16 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:16 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:25:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "name": "network-vif-plugged", "status": "completed", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}, {"server_uuid": "70d8306f-4030-4154-9d29-75961b8d4b9f", "name": "network-vif-deleted", "tag": "66622ff1-3310-46fb-b7e3-376fb09a0afb"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:25:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:16 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] Creating event network-vif-plugged:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:25:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] Creating event network-vif-deleted:66622ff1-3310-46fb-b7e3-376fb09a0afb for instance 70d8306f-4030-4154-9d29-75961b8d4b9f on user Apr 17 19:25:16 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-91f73acd-f03e-4f75-8444-7d995ad306a7 req-3b7ff9d1-470d-49bf-98ca-e6f4163e4e23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033221 Apr 17 19:25:16 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 72/217] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:25:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:21 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6982f6dfac4e889b49f3d09b768ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556ec6da247b4757b5f8919ad0c6f74f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:25:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-fec5c113-f8f6-4ef2-93a7-9651f4c86ef6 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 200 len: 1535 microversion: 2.1 time: 0.214598 Apr 17 19:25:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:25:21 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 1535 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=12 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:55 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] HTTP exception thrown: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Request method failure captured: Apr 17 19:25:55 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 HTTP/1.1 Apr 17 19:25:55 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:25:55 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:25:55 user devstack@n-api.service[61729]: Connection: close Apr 17 19:25:55 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:25:55 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:25:55 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:25:55 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:25:55 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZv1uhNsUeREqwI_Qjb1GpP52xgwtV4IxL6Ob2jKt133XLHBsKcEu1RIJtMN4kRCIWXfvVGL-aK_gtpXP8uWOFCu5Z95SYsa4C3kBnSXDRgz7uktqLfN7c18f7iUBEMZQfLOQhRqABVaG2dGRz6l5GIl4MMseGhqzI0shq_XUYRINF4 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Project-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Tenant: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Tenant-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:55 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-User: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:55 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:25:55 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:25:55 user devstack@n-api.service[61729]: X-User-Id: debe1c89740d483ab7581e9cfed413a0 Apr 17 19:25:55 user devstack@n-api.service[61729]: X-User-Name: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:55 user devstack@n-api.service[61729]: method: > Apr 17 19:25:55 user devstack@n-api.service[61729]: exception: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:55 user devstack@n-api.service[61729]: action_args: {'id': '98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66'} Apr 17 19:25:55 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:55 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:55 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Returning 404 to user: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:25:55 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-c34cd32b-3b81-4fb9-957b-177c18cdd2fb tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 404 len: 111 microversion: 2.20 time: 0.143167 Apr 17 19:25:55 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 74/219] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:25:55 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:25:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-15d7a1d3-a0d0-4dd2-8c21-fd90819381d7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '.version_select at 0x7f84d1ed4430>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-15d7a1d3-a0d0-4dd2-8c21-fd90819381d7 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718452069" status: 204 len: 0 microversion: 2.20 time: 0.028738 Apr 17 19:25:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 73/220] 10.0.0.210 () {64 vars in 1336 bytes} [Mon Apr 17 19:25:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718452069 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=16 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=40 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] HTTP exception thrown: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Request method failure captured: Apr 17 19:25:56 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 HTTP/1.1 Apr 17 19:25:56 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:25:56 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:25:56 user devstack@n-api.service[61728]: Connection: close Apr 17 19:25:56 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:25:56 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:25:56 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:25:56 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:25:56 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZv1uhNsUeREqwI_Qjb1GpP52xgwtV4IxL6Ob2jKt133XLHBsKcEu1RIJtMN4kRCIWXfvVGL-aK_gtpXP8uWOFCu5Z95SYsa4C3kBnSXDRgz7uktqLfN7c18f7iUBEMZQfLOQhRqABVaG2dGRz6l5GIl4MMseGhqzI0shq_XUYRINF4 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Tenant-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Id: debe1c89740d483ab7581e9cfed413a0 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61728]: method: > Apr 17 19:25:56 user devstack@n-api.service[61728]: exception: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: action_args: {'id': '98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66'} Apr 17 19:25:56 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Returning 404 to user: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:25:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-f07dde74-1efc-41b9-a95e-645de24037b2 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 404 len: 111 microversion: 2.20 time: 0.032929 Apr 17 19:25:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 74/221] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:25:56 2023] DELETE /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] HTTP exception thrown: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Request method failure captured: Apr 17 19:25:56 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 HTTP/1.1 Apr 17 19:25:56 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:25:56 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:25:56 user devstack@n-api.service[61729]: Connection: close Apr 17 19:25:56 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:25:56 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:25:56 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:25:56 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:25:56 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZv1uhNsUeREqwI_Qjb1GpP52xgwtV4IxL6Ob2jKt133XLHBsKcEu1RIJtMN4kRCIWXfvVGL-aK_gtpXP8uWOFCu5Z95SYsa4C3kBnSXDRgz7uktqLfN7c18f7iUBEMZQfLOQhRqABVaG2dGRz6l5GIl4MMseGhqzI0shq_XUYRINF4 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Project-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Tenant: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Tenant-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-User: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61729]: X-User-Id: debe1c89740d483ab7581e9cfed413a0 Apr 17 19:25:56 user devstack@n-api.service[61729]: X-User-Name: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61729]: method: > Apr 17 19:25:56 user devstack@n-api.service[61729]: exception: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61729]: action_args: {'id': '98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66'} Apr 17 19:25:56 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. Apr 17 19:25:56 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Returning 404 to user: Instance 98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:25:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-5e54ae56-d763-435c-9daf-903f66cef7ab tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66" status: 404 len: 111 microversion: 2.20 time: 0.027917 Apr 17 19:25:56 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 75/222] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:25:56 2023] GET /compute/v2.1/servers/98c64eb8-52ec-4d74-b2ac-16a0ff4a1b66 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] HTTP exception thrown: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Request method failure captured: Apr 17 19:25:56 user devstack@n-api.service[61727]: request: DELETE /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de HTTP/1.1 Apr 17 19:25:56 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:25:56 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:25:56 user devstack@n-api.service[61727]: Connection: close Apr 17 19:25:56 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:25:56 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:25:56 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:25:56 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:25:56 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZv1uhNsUeREqwI_Qjb1GpP52xgwtV4IxL6Ob2jKt133XLHBsKcEu1RIJtMN4kRCIWXfvVGL-aK_gtpXP8uWOFCu5Z95SYsa4C3kBnSXDRgz7uktqLfN7c18f7iUBEMZQfLOQhRqABVaG2dGRz6l5GIl4MMseGhqzI0shq_XUYRINF4 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Project-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Tenant-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61727]: X-User-Id: debe1c89740d483ab7581e9cfed413a0 Apr 17 19:25:56 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61727]: method: > Apr 17 19:25:56 user devstack@n-api.service[61727]: exception: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61727]: action_args: {'id': 'ff662a93-859a-46d9-9d6f-417df47860de'} Apr 17 19:25:56 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Returning 404 to user: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:25:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-023db431-3c1a-4d74-bfc5-07d7f2987271 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 404 len: 111 microversion: 2.20 time: 0.027462 Apr 17 19:25:56 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 74/223] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:25:56 2023] DELETE /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] [instance: ff662a93-859a-46d9-9d6f-417df47860de] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:25:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] HTTP exception thrown: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Request method failure captured: Apr 17 19:25:56 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de HTTP/1.1 Apr 17 19:25:56 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:25:56 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:25:56 user devstack@n-api.service[61728]: Connection: close Apr 17 19:25:56 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:25:56 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:25:56 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:25:56 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:25:56 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZv1uhNsUeREqwI_Qjb1GpP52xgwtV4IxL6Ob2jKt133XLHBsKcEu1RIJtMN4kRCIWXfvVGL-aK_gtpXP8uWOFCu5Z95SYsa4C3kBnSXDRgz7uktqLfN7c18f7iUBEMZQfLOQhRqABVaG2dGRz6l5GIl4MMseGhqzI0shq_XUYRINF4 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.20 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a0510183fad34a10b0c0bf6c72317faf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Tenant-Id: a0510183fad34a10b0c0bf6c72317faf Apr 17 19:25:56 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-502633731 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Id: debe1c89740d483ab7581e9cfed413a0 Apr 17 19:25:56 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeShelveTestJSON-502633731-project-member Apr 17 19:25:56 user devstack@n-api.service[61728]: method: > Apr 17 19:25:56 user devstack@n-api.service[61728]: exception: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: action_args: {'id': 'ff662a93-859a-46d9-9d6f-417df47860de'} Apr 17 19:25:56 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. Apr 17 19:25:56 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:25:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] Returning 404 to user: Instance ff662a93-859a-46d9-9d6f-417df47860de could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:25:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d4272113-5d4d-47c4-8f8a-0a220bfdef63 tempest-AttachVolumeShelveTestJSON-502633731 tempest-AttachVolumeShelveTestJSON-502633731-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de" status: 404 len: 111 microversion: 2.20 time: 0.026169 Apr 17 19:25:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 75/224] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:25:56 2023] GET /compute/v2.1/servers/ff662a93-859a-46d9-9d6f-417df47860de => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:26:01 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-979331799", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "e7a6280a-93ff-4c57-8b63-ab13755c3ae2"}]}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:01 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] validate_networks() for [('e7a6280a-93ff-4c57-8b63-ab13755c3ae2', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for user 564b229ded9c40dfa3a6afc15663c832 and project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:26:02 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:26:02 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-5307f72d-0b4d-4cde-a699-61271397074c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.628387 Apr 17 19:26:02 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 76/225] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 19:26:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 19:26:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-d181a60c-c033-48e9-be55-d4c1632df425 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:02 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-d181a60c-c033-48e9-be55-d4c1632df425 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:02 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d181a60c-c033-48e9-be55-d4c1632df425 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:02 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d181a60c-c033-48e9-be55-d4c1632df425 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:02 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-d181a60c-c033-48e9-be55-d4c1632df425 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-d181a60c-c033-48e9-be55-d4c1632df425 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44" status: 200 len: 1394 microversion: 2.87 time: 0.068599 Apr 17 19:26:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 75/226] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:26:02 2023] GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44 => generated 1394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] [instance: 70d8306f-4030-4154-9d29-75961b8d4b9f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:04 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] HTTP exception thrown: Instance 70d8306f-4030-4154-9d29-75961b8d4b9f could not be found. Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Request method failure captured: Apr 17 19:26:04 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f HTTP/1.1 Apr 17 19:26:04 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:26:04 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:26:04 user devstack@n-api.service[61728]: Connection: close Apr 17 19:26:04 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:26:04 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:26:04 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:26:04 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:26:04 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZv4IxwZt3POgouRCQsLEBbHNN8BXEQ8xEOB6bn3TJGqukaXIN0oXdSdmCO2eIj1_OYUeDQs2xh_nfeAl6cM29rezUwN_8Db_DJmkgP4JGhPZa9hhYobCerGoN6bhwRJ8JIKnb9hH40i7UBYrUsiejidioNxYOCaoPj8IdI5ipTRhVg Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Project-Id: f0dc0655c8314e08b62c8ae370d488cb Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Project-Name: tempest-VolumesAdminNegativeTest-1507040722 Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f0dc0655c8314e08b62c8ae370d488cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0dc0655c8314e08b62c8ae370d488cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f0dc0655c8314e08b62c8ae370d488cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Tenant: tempest-VolumesAdminNegativeTest-1507040722 Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Tenant-Id: f0dc0655c8314e08b62c8ae370d488cb Apr 17 19:26:04 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1507040722 Apr 17 19:26:04 user devstack@n-api.service[61728]: X-User: tempest-VolumesAdminNegativeTest-1507040722-project-member Apr 17 19:26:04 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:26:04 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:26:04 user devstack@n-api.service[61728]: X-User-Id: 9fbcd21255b546fb9a14ece87286731b Apr 17 19:26:04 user devstack@n-api.service[61728]: X-User-Name: tempest-VolumesAdminNegativeTest-1507040722-project-member Apr 17 19:26:04 user devstack@n-api.service[61728]: method: > Apr 17 19:26:04 user devstack@n-api.service[61728]: exception: Instance 70d8306f-4030-4154-9d29-75961b8d4b9f could not be found. Apr 17 19:26:04 user devstack@n-api.service[61728]: action_args: {'id': '70d8306f-4030-4154-9d29-75961b8d4b9f'} Apr 17 19:26:04 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d8306f-4030-4154-9d29-75961b8d4b9f could not be found. Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d8306f-4030-4154-9d29-75961b8d4b9f could not be found. Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d8306f-4030-4154-9d29-75961b8d4b9f could not be found. Apr 17 19:26:04 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:26:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Returning 404 to user: Instance 70d8306f-4030-4154-9d29-75961b8d4b9f could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:26:04 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-564475db-621f-40ab-9198-8be38fb14be1 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f" status: 404 len: 111 microversion: 2.1 time: 0.232908 Apr 17 19:26:04 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 76/227] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:26:04 2023] GET /compute/v2.1/servers/70d8306f-4030-4154-9d29-75961b8d4b9f => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:26:04 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b82e41f1-734a-4eac-bcd6-6801b78df242 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] Calling method '.version_select at 0x7f84d1ea16c0>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:04 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-b82e41f1-734a-4eac-bcd6-6801b78df242 tempest-VolumesAdminNegativeTest-1507040722 tempest-VolumesAdminNegativeTest-1507040722-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775960129" status: 202 len: 0 microversion: 2.1 time: 0.027417 Apr 17 19:26:04 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:26:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1775960129 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:26:05 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-5ff237d9-b519-4e0a-b5d2-2b1a4fe034cd req-1bf781b3-0834-424f-8bd1-821bd12c05f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0932108-c0fc-41d8-a5cd-96af63350c44", "tag": "f5a9e009-9fa8-494b-92f3-a4776580dfc9"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5ff237d9-b519-4e0a-b5d2-2b1a4fe034cd req-1bf781b3-0834-424f-8bd1-821bd12c05f4 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5ff237d9-b519-4e0a-b5d2-2b1a4fe034cd req-1bf781b3-0834-424f-8bd1-821bd12c05f4 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:05 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-5ff237d9-b519-4e0a-b5d2-2b1a4fe034cd req-1bf781b3-0834-424f-8bd1-821bd12c05f4 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-5ff237d9-b519-4e0a-b5d2-2b1a4fe034cd req-1bf781b3-0834-424f-8bd1-821bd12c05f4 service nova] Creating event network-changed:f5a9e009-9fa8-494b-92f3-a4776580dfc9 for instance d0932108-c0fc-41d8-a5cd-96af63350c44 on user Apr 17 19:26:05 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-5ff237d9-b519-4e0a-b5d2-2b1a4fe034cd req-1bf781b3-0834-424f-8bd1-821bd12c05f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037662 Apr 17 19:26:05 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 76/229] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:09 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-4877796a-c5ef-4be8-a9bf-4771c4ff5078 req-997e780d-2325-4230-9e1d-5ecc2c336430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0932108-c0fc-41d8-a5cd-96af63350c44", "name": "network-vif-deleted", "tag": "f5a9e009-9fa8-494b-92f3-a4776580dfc9"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4877796a-c5ef-4be8-a9bf-4771c4ff5078 req-997e780d-2325-4230-9e1d-5ecc2c336430 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4877796a-c5ef-4be8-a9bf-4771c4ff5078 req-997e780d-2325-4230-9e1d-5ecc2c336430 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-4877796a-c5ef-4be8-a9bf-4771c4ff5078 req-997e780d-2325-4230-9e1d-5ecc2c336430 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:09 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.compute.server_external_events [req-4877796a-c5ef-4be8-a9bf-4771c4ff5078 req-997e780d-2325-4230-9e1d-5ecc2c336430 service nova] Unable to find a host for instance d0932108-c0fc-41d8-a5cd-96af63350c44. Dropping event network-vif-deleted {{(pid=61728) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 17 19:26:09 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-4877796a-c5ef-4be8-a9bf-4771c4ff5078 req-997e780d-2325-4230-9e1d-5ecc2c336430 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.054601 Apr 17 19:26:09 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:09 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:12 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:12 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-a36f8950-20dd-446c-8122-60b18d3d5ef4 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1493 microversion: 2.1 time: 0.213543 Apr 17 19:26:12 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:26:12 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1493 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:18 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4e87e59f-5777-48b1-bd73-3772aa79e2d2 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.246514 Apr 17 19:26:18 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 77/232] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:26:18 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e8b5b9fe-2c5a-41ac-8e01-9232b9788759 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.173283 Apr 17 19:26:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:26:21 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354/os-interface => generated 282 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:22 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-19b18e79-84d2-4a34-b7f4-507b22902dac req-d9eece40-18f2-4846-99c2-194786577482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:22 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:22 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=12 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:22 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-19b18e79-84d2-4a34-b7f4-507b22902dac req-d9eece40-18f2-4846-99c2-194786577482 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:22 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-19b18e79-84d2-4a34-b7f4-507b22902dac req-d9eece40-18f2-4846-99c2-194786577482 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:22 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-19b18e79-84d2-4a34-b7f4-507b22902dac req-d9eece40-18f2-4846-99c2-194786577482 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:22 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-19b18e79-84d2-4a34-b7f4-507b22902dac req-d9eece40-18f2-4846-99c2-194786577482 service nova] Creating event network-changed:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:26:22 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-19b18e79-84d2-4a34-b7f4-507b22902dac req-d9eece40-18f2-4846-99c2-194786577482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037607 Apr 17 19:26:22 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2142cd47-15f3-4d5e-99a5-6ea30064fefb tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354/ips" status: 200 len: 103 microversion: 2.1 time: 0.033196 Apr 17 19:26:22 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 78/235] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:26:22 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354/ips => generated 103 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-af657c3f-4d8e-4806-8af9-8989c74a8f49 tempest-TestVolumeBootPattern-2142297086 tempest-TestVolumeBootPattern-2142297086-project-member] Action: 'create', calling method: .version_select at 0x7f84d1eed2d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-781417056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAedBI2BaEUOTEUSE/0mWSRNbmhSI3+d5z5tVZavHryElAtxmBQ33wefXxlpRF2vTZNyQ9Kql/VSIPYC1Ikm3Xs4dEurMZEmsmWsvIytEgLmps1pLUu16+3XfrRq8ExWw=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:23 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-af657c3f-4d8e-4806-8af9-8989c74a8f49 tempest-TestVolumeBootPattern-2142297086 tempest-TestVolumeBootPattern-2142297086-project-member] Getting quotas for project 0a03c7aaf27546ec9010285ad7ece74c. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:26:23 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-af657c3f-4d8e-4806-8af9-8989c74a8f49 tempest-TestVolumeBootPattern-2142297086 tempest-TestVolumeBootPattern-2142297086-project-member] Getting quotas for user 20c2952ba56c4b4487a874d689abd146 and project 0a03c7aaf27546ec9010285ad7ece74c. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:26:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-af657c3f-4d8e-4806-8af9-8989c74a8f49 tempest-TestVolumeBootPattern-2142297086 tempest-TestVolumeBootPattern-2142297086-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.052382 Apr 17 19:26:23 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 79/236] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:26:23 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:24 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:26:24 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-40068d0b-4d05-4c32-8b03-3184a2267aa9 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 204 len: 0 microversion: 2.1 time: 0.114472 Apr 17 19:26:24 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:26:24 2023] DELETE /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:24 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6982f6dfac4e889b49f3d09b768ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556ec6da247b4757b5f8919ad0c6f74f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:24 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a835eedc-4e72-4951-9693-f0d1cb15582b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 200 len: 1660 microversion: 2.1 time: 0.166891 Apr 17 19:26:24 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:26:24 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 1660 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:26:24 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-f3577762-9768-468a-9800-28e183f56d96 req-eb3f6b78-6b4c-498a-bdb7-1066b262ee6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "name": "network-vif-unplugged", "status": "completed", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f3577762-9768-468a-9800-28e183f56d96 req-eb3f6b78-6b4c-498a-bdb7-1066b262ee6d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f3577762-9768-468a-9800-28e183f56d96 req-eb3f6b78-6b4c-498a-bdb7-1066b262ee6d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f3577762-9768-468a-9800-28e183f56d96 req-eb3f6b78-6b4c-498a-bdb7-1066b262ee6d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f3577762-9768-468a-9800-28e183f56d96 req-eb3f6b78-6b4c-498a-bdb7-1066b262ee6d service nova] Creating event network-vif-unplugged:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:26:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-f3577762-9768-468a-9800-28e183f56d96 req-eb3f6b78-6b4c-498a-bdb7-1066b262ee6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204019 Apr 17 19:26:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 80/239] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:26 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-8b8cf025-ba41-466e-b02e-91a2b36b94de req-92d49f46-3ac5-42bd-9eb4-4288756b6034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "name": "network-vif-deleted", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8b8cf025-ba41-466e-b02e-91a2b36b94de req-92d49f46-3ac5-42bd-9eb4-4288756b6034 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8b8cf025-ba41-466e-b02e-91a2b36b94de req-92d49f46-3ac5-42bd-9eb4-4288756b6034 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8b8cf025-ba41-466e-b02e-91a2b36b94de req-92d49f46-3ac5-42bd-9eb4-4288756b6034 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:26 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-8b8cf025-ba41-466e-b02e-91a2b36b94de req-92d49f46-3ac5-42bd-9eb4-4288756b6034 service nova] Creating event network-vif-deleted:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:26:26 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-8b8cf025-ba41-466e-b02e-91a2b36b94de req-92d49f46-3ac5-42bd-9eb4-4288756b6034 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028072 Apr 17 19:26:26 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 81/240] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b8f7f823-523d-4283-bff6-a5bde2f176d3 tempest-TestVolumeBootPattern-2142297086 tempest-TestVolumeBootPattern-2142297086-project-member] Calling method '.version_select at 0x7f84d1ed7010>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:26 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b8f7f823-523d-4283-bff6-a5bde2f176d3 tempest-TestVolumeBootPattern-2142297086 tempest-TestVolumeBootPattern-2142297086-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-781417056" status: 202 len: 0 microversion: 2.1 time: 0.024061 Apr 17 19:26:26 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 80/241] 10.0.0.210 () {62 vars in 1337 bytes} [Mon Apr 17 19:26:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-781417056 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:26:26 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-fd239fa6-5514-473c-ab01-90f59d48d15e req-02f974dd-6c5f-40f5-a2ab-8f894b83e99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756691bf-01bc-480e-b3cb-182020386354", "name": "network-vif-plugged", "status": "completed", "tag": "c8b9090d-afb6-4b60-acaf-608fea1c82f6"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fd239fa6-5514-473c-ab01-90f59d48d15e req-02f974dd-6c5f-40f5-a2ab-8f894b83e99d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fd239fa6-5514-473c-ab01-90f59d48d15e req-02f974dd-6c5f-40f5-a2ab-8f894b83e99d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:26 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-fd239fa6-5514-473c-ab01-90f59d48d15e req-02f974dd-6c5f-40f5-a2ab-8f894b83e99d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-fd239fa6-5514-473c-ab01-90f59d48d15e req-02f974dd-6c5f-40f5-a2ab-8f894b83e99d service nova] Creating event network-vif-plugged:c8b9090d-afb6-4b60-acaf-608fea1c82f6 for instance 756691bf-01bc-480e-b3cb-182020386354 on user Apr 17 19:26:26 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-fd239fa6-5514-473c-ab01-90f59d48d15e req-02f974dd-6c5f-40f5-a2ab-8f894b83e99d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027466 Apr 17 19:26:26 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 81/242] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:50 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:50 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:50 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f3a4a4e3-bc8f-48f6-816c-5973a4f3dd69 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Action: 'create', calling method: .version_select at 0x7f84d1e05240>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1273943855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVD136bv74Gab5KCFJpcy2FFXkk+CauMLZpaTWXr8NE/TtZq+1iRlGJcGITHysAx77CBWuqK1H5ck5ZaQSCxaXOSUy537x0Wy+WoqFAbNLp61y0JpsB+G8VHBa/kDOfJw=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:50 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-f3a4a4e3-bc8f-48f6-816c-5973a4f3dd69 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Getting quotas for project e4cd64d251bb4dd4a678262e95a3d0a5. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:26:50 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-f3a4a4e3-bc8f-48f6-816c-5973a4f3dd69 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Getting quotas for user 20ec6b067a9748b28c34d3e4bc002215 and project e4cd64d251bb4dd4a678262e95a3d0a5. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:26:50 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-f3a4a4e3-bc8f-48f6-816c-5973a4f3dd69 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.245125 Apr 17 19:26:50 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 82/243] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:26:50 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=16 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:51 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1903773649", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1273943855", "security_groups": [{"name": "tempest-secgroup-smoke-1337443382"}], "networks": [{"uuid": "db4a515e-21cd-4234-803c-6a35e67f7d05"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] validate_networks() for [('db4a515e-21cd-4234-803c-6a35e67f7d05', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.objects.instance [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lazy-loading 'fault' on Instance uuid d0932108-c0fc-41d8-a5cd-96af63350c44 {{(pid=61728) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Getting quotas for project e4cd64d251bb4dd4a678262e95a3d0a5. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Getting quotas for user 20ec6b067a9748b28c34d3e4bc002215 and project e4cd64d251bb4dd4a678262e95a3d0a5. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:26:52 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:52 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-12e29ecd-c5ac-4b17-86b6-9aa11ee3f2fd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44" status: 200 len: 1649 microversion: 2.87 time: 0.114681 Apr 17 19:26:52 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:26:52 2023] GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44 => generated 1649 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:26:52 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-63fbee85-d609-47cc-b00b-fc00830c90ae tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.942110 Apr 17 19:26:52 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 81/245] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:26:51 2023] POST /compute/v2.1/servers => generated 404 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d031963b-8914-46ca-8792-2fbb1de2af6c tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d031963b-8914-46ca-8792-2fbb1de2af6c tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:26:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-d031963b-8914-46ca-8792-2fbb1de2af6c tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec6b067a9748b28c34d3e4bc002215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd64d251bb4dd4a678262e95a3d0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:52 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d031963b-8914-46ca-8792-2fbb1de2af6c tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e" status: 200 len: 1257 microversion: 2.1 time: 0.062709 Apr 17 19:26:52 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:26:52 2023] GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e => generated 1257 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Doing local delete in cell 557b61a6-7c46-4750-bdf8-90d5a8f88bb1(cell1) {{(pid=61729) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:52 user devstack@n-api.service[61729]: WARNING nova.compute.api [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] instance's host None is down, deleting from database Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] deallocate_for_instance() {{(pid=61729) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 17 19:26:52 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Instance cache missing network info. {{(pid=61729) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 17 19:26:53 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Updating instance_info_cache with network_info: [] {{(pid=61729) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 17 19:26:53 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61729) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 17 19:26:53 user devstack@n-api.service[61729]: WARNING nova.compute.api [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 17 19:26:53 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-187d310c-8ef7-4ec9-9e52-d83c60ac7aff tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44" status: 204 len: 0 microversion: 2.87 time: 0.503260 Apr 17 19:26:53 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:26:52 2023] DELETE /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: d0932108-c0fc-41d8-a5cd-96af63350c44] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] HTTP exception thrown: Instance d0932108-c0fc-41d8-a5cd-96af63350c44 could not be found. Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Request method failure captured: Apr 17 19:26:53 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44 HTTP/1.1 Apr 17 19:26:53 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:26:53 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:26:53 user devstack@n-api.service[61727]: Connection: close Apr 17 19:26:53 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:26:53 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:26:53 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:26:53 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:26:53 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZyYhefhexC3Wln-iK8NmMF8eZM_NocbDF2S7QpSjfZaKcDug-dWkqGyVdDQ3n9_UxLR7uQHxl3B-Z4iCQVxKv8Z-5yJCzQ9w7CxQ_xoFvbT_CiNrM1BLTwU84AJ_lO54qVOobgQWlZuVaCuaAz5SL_hTeZrU56c0XtLTgANZltbWsk Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Project-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Tenant-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:26:53 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:26:53 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:26:53 user devstack@n-api.service[61727]: X-User-Id: 564b229ded9c40dfa3a6afc15663c832 Apr 17 19:26:53 user devstack@n-api.service[61727]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:26:53 user devstack@n-api.service[61727]: method: > Apr 17 19:26:53 user devstack@n-api.service[61727]: exception: Instance d0932108-c0fc-41d8-a5cd-96af63350c44 could not be found. Apr 17 19:26:53 user devstack@n-api.service[61727]: action_args: {'id': 'd0932108-c0fc-41d8-a5cd-96af63350c44'} Apr 17 19:26:53 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0932108-c0fc-41d8-a5cd-96af63350c44 could not be found. Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0932108-c0fc-41d8-a5cd-96af63350c44 could not be found. Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0932108-c0fc-41d8-a5cd-96af63350c44 could not be found. Apr 17 19:26:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:26:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Returning 404 to user: Instance d0932108-c0fc-41d8-a5cd-96af63350c44 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:26:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-853e8b4e-c423-4814-b634-dda6932365f3 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44" status: 404 len: 111 microversion: 2.87 time: 0.032838 Apr 17 19:26:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 82/248] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:26:53 2023] GET /compute/v2.1/servers/d0932108-c0fc-41d8-a5cd-96af63350c44 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:26:53 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-573934540", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "networks": [{"uuid": "e7a6280a-93ff-4c57-8b63-ab13755c3ae2"}]}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:53 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] validate_networks() for [('e7a6280a-93ff-4c57-8b63-ab13755c3ae2', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for user 564b229ded9c40dfa3a6afc15663c832 and project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:26:54 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:26:54 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-acb141b5-48ce-4588-acdb-c45797500f27 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.761699 Apr 17 19:26:54 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 84/249] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 19:26:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 19:26:54 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-473ff346-f055-4695-8ada-8bcd8dc81067 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:26:54 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-473ff346-f055-4695-8ada-8bcd8dc81067 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:26:54 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-473ff346-f055-4695-8ada-8bcd8dc81067 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:54 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-473ff346-f055-4695-8ada-8bcd8dc81067 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:54 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-473ff346-f055-4695-8ada-8bcd8dc81067 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:26:54 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-473ff346-f055-4695-8ada-8bcd8dc81067 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e" status: 200 len: 1394 microversion: 2.87 time: 0.074185 Apr 17 19:26:54 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 84/250] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:26:54 2023] GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e => generated 1394 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:26:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-90d51dd2-0982-4af2-8375-fa12ad61082d req-f459f8f4-acb6-48e3-bd5d-24ebf8d5d271 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e67a686c-07b7-4438-af74-a8e5303dfe2e", "tag": "4bf87be4-145d-4434-9975-e9b61471eab4"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-90d51dd2-0982-4af2-8375-fa12ad61082d req-f459f8f4-acb6-48e3-bd5d-24ebf8d5d271 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-90d51dd2-0982-4af2-8375-fa12ad61082d req-f459f8f4-acb6-48e3-bd5d-24ebf8d5d271 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-90d51dd2-0982-4af2-8375-fa12ad61082d req-f459f8f4-acb6-48e3-bd5d-24ebf8d5d271 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-90d51dd2-0982-4af2-8375-fa12ad61082d req-f459f8f4-acb6-48e3-bd5d-24ebf8d5d271 service nova] Creating event network-changed:4bf87be4-145d-4434-9975-e9b61471eab4 for instance e67a686c-07b7-4438-af74-a8e5303dfe2e on user Apr 17 19:26:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-90d51dd2-0982-4af2-8375-fa12ad61082d req-f459f8f4-acb6-48e3-bd5d-24ebf8d5d271 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028779 Apr 17 19:26:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 83/251] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-c3f8d2fd-5736-4952-a9a5-339daf531e1e req-8361055e-ee38-4276-8a84-05054a217547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c3f8d2fd-5736-4952-a9a5-339daf531e1e req-8361055e-ee38-4276-8a84-05054a217547 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c3f8d2fd-5736-4952-a9a5-339daf531e1e req-8361055e-ee38-4276-8a84-05054a217547 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c3f8d2fd-5736-4952-a9a5-339daf531e1e req-8361055e-ee38-4276-8a84-05054a217547 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-c3f8d2fd-5736-4952-a9a5-339daf531e1e req-8361055e-ee38-4276-8a84-05054a217547 service nova] Creating event network-changed:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:26:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-c3f8d2fd-5736-4952-a9a5-339daf531e1e req-8361055e-ee38-4276-8a84-05054a217547 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028961 Apr 17 19:26:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:58 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67a686c-07b7-4438-af74-a8e5303dfe2e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf87be4-145d-4434-9975-e9b61471eab4"}, {"server_uuid": "e67a686c-07b7-4438-af74-a8e5303dfe2e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf87be4-145d-4434-9975-e9b61471eab4"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] Creating event network-vif-plugged:4bf87be4-145d-4434-9975-e9b61471eab4 for instance e67a686c-07b7-4438-af74-a8e5303dfe2e on user Apr 17 19:26:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] Creating event network-vif-plugged:4bf87be4-145d-4434-9975-e9b61471eab4 for instance e67a686c-07b7-4438-af74-a8e5303dfe2e on user Apr 17 19:26:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-904b2348-51f9-45a0-b973-1c78b7ea4af3 req-29d0614d-4c74-4c2d-918a-6ab948580739 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.027731 Apr 17 19:26:58 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:26:59 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-0588a363-3afd-4f02-8057-b58c2b733d82 req-5df96b0f-c1f3-4c31-b885-9d95d7e50ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-plugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:26:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0588a363-3afd-4f02-8057-b58c2b733d82 req-5df96b0f-c1f3-4c31-b885-9d95d7e50ea2 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:26:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0588a363-3afd-4f02-8057-b58c2b733d82 req-5df96b0f-c1f3-4c31-b885-9d95d7e50ea2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:26:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0588a363-3afd-4f02-8057-b58c2b733d82 req-5df96b0f-c1f3-4c31-b885-9d95d7e50ea2 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:26:59 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-0588a363-3afd-4f02-8057-b58c2b733d82 req-5df96b0f-c1f3-4c31-b885-9d95d7e50ea2 service nova] Creating event network-vif-plugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:26:59 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-0588a363-3afd-4f02-8057-b58c2b733d82 req-5df96b0f-c1f3-4c31-b885-9d95d7e50ea2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081397 Apr 17 19:26:59 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 84/254] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:27:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-1a5bdd2f-fbc9-4415-824a-1d436df08fef req-b81da879-92e4-4c31-901b-79069868ca07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-plugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:27:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-1a5bdd2f-fbc9-4415-824a-1d436df08fef req-b81da879-92e4-4c31-901b-79069868ca07 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-1a5bdd2f-fbc9-4415-824a-1d436df08fef req-b81da879-92e4-4c31-901b-79069868ca07 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-1a5bdd2f-fbc9-4415-824a-1d436df08fef req-b81da879-92e4-4c31-901b-79069868ca07 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-1a5bdd2f-fbc9-4415-824a-1d436df08fef req-b81da879-92e4-4c31-901b-79069868ca07 service nova] Creating event network-vif-plugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:27:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-1a5bdd2f-fbc9-4415-824a-1d436df08fef req-b81da879-92e4-4c31-901b-79069868ca07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029987 Apr 17 19:27:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:14 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-7b2d0f5d-3d97-4227-9b49-2441730b3ead tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1493 microversion: 2.1 time: 0.235530 Apr 17 19:27:14 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 86/256] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:14 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1493 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] HTTP exception thrown: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Request method failure captured: Apr 17 19:27:14 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 HTTP/1.1 Apr 17 19:27:14 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:27:14 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:27:14 user devstack@n-api.service[61727]: Connection: close Apr 17 19:27:14 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:27:14 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:27:14 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:27:14 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:27:14 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZztjyIjPcZmYI3o17TAnQmIrUGsTF2NDOXWIq5XSFM3xur6SA5k4iBsHK1gA0n_6fznIYFZG-bf7ndyhkKr1TTib2yLnPPPNhoq4CqQc9mYBRhyLqa5NFdBOc8Dq80pSPQlaDDvxo7BJ_Rmyk9N3UDFpa8YyTnC3ozQ1YpQWf14ItE Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Project-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Tenant-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:27:14 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:27:14 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:27:14 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:27:14 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:27:14 user devstack@n-api.service[61727]: X-User-Id: be6982f6dfac4e889b49f3d09b768ab9 Apr 17 19:27:14 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:27:14 user devstack@n-api.service[61727]: method: > Apr 17 19:27:14 user devstack@n-api.service[61727]: exception: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:27:14 user devstack@n-api.service[61727]: action_args: {'id': '756691bf-01bc-480e-b3cb-182020386354'} Apr 17 19:27:14 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:27:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:27:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Returning 404 to user: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:27:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4f60009a-9d42-40e9-a6b9-d7eb57f4bc67 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 404 len: 111 microversion: 2.1 time: 0.038903 Apr 17 19:27:14 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 85/257] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:14 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:27:14 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=14 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-a3640b2a-beeb-4534-88bf-d9ea6bdae4ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '.version_select at 0x7f84d1eec940>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-a3640b2a-beeb-4534-88bf-d9ea6bdae4ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-223358557" status: 202 len: 0 microversion: 2.1 time: 0.032264 Apr 17 19:27:14 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 87/258] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 17 19:27:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-223358557 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:27:15 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c8e3c0af-f744-4351-b1bc-1413c07a7d2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Action: 'create', calling method: .version_select at 0x7f84d1c257e0>, body: {"keypair": {"name": "tempest-keypair-1216049893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8pghbS/grB1fLgAdFFEbKI9Ux2uSjZgP4QEQkhqMkSFxWn9RIkNjFTWIMxrPZQBB9J39/rR+VMsUNUUIDOGXb3Wc7TrHWmUwbGbg34WHGIV1sjMVgxk6T9/TqsjchjoA=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:27:15 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-c8e3c0af-f744-4351-b1bc-1413c07a7d2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:27:15 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-c8e3c0af-f744-4351-b1bc-1413c07a7d2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for user be6982f6dfac4e889b49f3d09b768ab9 and project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:27:15 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-c8e3c0af-f744-4351-b1bc-1413c07a7d2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046165 Apr 17 19:27:15 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:27:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:27:16 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1310117122", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "063d28ee-f0b9-491c-931e-2f16c7d13e88"}], "security_groups": [{"name": "tempest-securitygroup--1607350649"}], "key_name": "tempest-keypair-1216049893", "user_data": "}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:27:16 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] validate_networks() for [('063d28ee-f0b9-491c-931e-2f16c7d13e88', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Getting quotas for user be6982f6dfac4e889b49f3d09b768ab9 and project 556ec6da247b4757b5f8919ad0c6f74f. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:27:17 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:27:17 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a32c9512-d6c9-43df-8aa2-8787ff9506ef tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.837058 Apr 17 19:27:17 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 86/260] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:27:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:27:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-22f3456c-95ba-408f-ba24-ff2451c59a2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:17 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-22f3456c-95ba-408f-ba24-ff2451c59a2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:17 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-22f3456c-95ba-408f-ba24-ff2451c59a2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6982f6dfac4e889b49f3d09b768ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556ec6da247b4757b5f8919ad0c6f74f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:17 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-22f3456c-95ba-408f-ba24-ff2451c59a2b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 200 len: 1232 microversion: 2.1 time: 0.066947 Apr 17 19:27:17 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 88/261] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:17 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 1232 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:18 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:18 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-0b2e2d9d-997b-4ef2-877f-d84245acb452 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.285049 Apr 17 19:27:18 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:18 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:18 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-fcc03767-3a1a-4d0c-b00d-9fca76272f32 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.218409 Apr 17 19:27:18 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 87/263] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:18 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:19 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:19 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ec996b68-069f-4193-a4fb-1bc210a1933c tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.145378 Apr 17 19:27:19 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 89/264] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:18 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:27:20 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-38b927bc-9bad-4af1-b1e8-e4569d81c376 req-4eae4ed9-4111-4a5f-bd5e-25f7c9643b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:27:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-38b927bc-9bad-4af1-b1e8-e4569d81c376 req-4eae4ed9-4111-4a5f-bd5e-25f7c9643b8a service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-38b927bc-9bad-4af1-b1e8-e4569d81c376 req-4eae4ed9-4111-4a5f-bd5e-25f7c9643b8a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:20 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-38b927bc-9bad-4af1-b1e8-e4569d81c376 req-4eae4ed9-4111-4a5f-bd5e-25f7c9643b8a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:20 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-38b927bc-9bad-4af1-b1e8-e4569d81c376 req-4eae4ed9-4111-4a5f-bd5e-25f7c9643b8a service nova] Creating event network-changed:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:27:20 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-38b927bc-9bad-4af1-b1e8-e4569d81c376 req-4eae4ed9-4111-4a5f-bd5e-25f7c9643b8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032709 Apr 17 19:27:20 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:27:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:27:22 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-7c51b73b-e598-45eb-82cb-246061a03a5f req-f7715769-ea17-4b50-b0af-e9ad49c991e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "name": "network-vif-plugged", "status": "completed", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:27:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7c51b73b-e598-45eb-82cb-246061a03a5f req-f7715769-ea17-4b50-b0af-e9ad49c991e5 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7c51b73b-e598-45eb-82cb-246061a03a5f req-f7715769-ea17-4b50-b0af-e9ad49c991e5 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:22 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-7c51b73b-e598-45eb-82cb-246061a03a5f req-f7715769-ea17-4b50-b0af-e9ad49c991e5 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-7c51b73b-e598-45eb-82cb-246061a03a5f req-f7715769-ea17-4b50-b0af-e9ad49c991e5 service nova] Creating event network-vif-plugged:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:27:22 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-7c51b73b-e598-45eb-82cb-246061a03a5f req-f7715769-ea17-4b50-b0af-e9ad49c991e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037849 Apr 17 19:27:22 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 88/266] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:27:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:27:24 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-6018b23f-8aff-4c78-8f56-75d264184797 req-f5ea082c-9e01-41e9-a5b7-5673691679aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "name": "network-vif-plugged", "status": "completed", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:27:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6018b23f-8aff-4c78-8f56-75d264184797 req-f5ea082c-9e01-41e9-a5b7-5673691679aa service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6018b23f-8aff-4c78-8f56-75d264184797 req-f5ea082c-9e01-41e9-a5b7-5673691679aa service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:24 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-6018b23f-8aff-4c78-8f56-75d264184797 req-f5ea082c-9e01-41e9-a5b7-5673691679aa service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-6018b23f-8aff-4c78-8f56-75d264184797 req-f5ea082c-9e01-41e9-a5b7-5673691679aa service nova] Creating event network-vif-plugged:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:27:24 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-6018b23f-8aff-4c78-8f56-75d264184797 req-f5ea082c-9e01-41e9-a5b7-5673691679aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Apr 17 19:27:24 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 90/267] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:27:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:27:42 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:42 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=14 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:43 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec6b067a9748b28c34d3e4bc002215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd64d251bb4dd4a678262e95a3d0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:43 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-f265f4b5-c411-4e3d-892d-7909313587d7 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e" status: 200 len: 1570 microversion: 2.1 time: 0.221208 Apr 17 19:27:43 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 90/268] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:27:42 2023] GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:27:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-fb923dc9-5738-463c-a768-7b05e3583fdd tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e" status: 200 len: 1690 microversion: 2.87 time: 0.254343 Apr 17 19:27:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 89/269] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:27:44 2023] GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:07 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:08 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6982f6dfac4e889b49f3d09b768ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556ec6da247b4757b5f8919ad0c6f74f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b95e0718-68fb-4157-a3f3-2aa9ab475714 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 200 len: 1538 microversion: 2.1 time: 0.214544 Apr 17 19:28:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 91/270] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:28:07 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 1538 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] HTTP exception thrown: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Request method failure captured: Apr 17 19:28:14 user devstack@n-api.service[61729]: request: DELETE /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b HTTP/1.1 Apr 17 19:28:14 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:28:14 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:28:14 user devstack@n-api.service[61729]: Connection: close Apr 17 19:28:14 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:28:14 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:28:14 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:28:14 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:28:14 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZvGx4lZw7BzTPxtO0iTp3eFn2_eSmj0ugKiIZCZmROgs8jgNLhHNGiKlNW5eiAh7kjy8TyIqseCT1oT_fo--oPKC8FsRXG0wTgBswjRsrYAlnV5VYwLQ6WHgq4m1SYMt6WegS3VwqvCzbUTjU6mSY13ibzp0tPd0tzqKceYelTWCNQ Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Project-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Project-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Tenant: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Tenant-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:28:14 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:28:14 user devstack@n-api.service[61729]: X-User: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:28:14 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:28:14 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:28:14 user devstack@n-api.service[61729]: X-User-Id: 82191afa221843d9ba371a0082792089 Apr 17 19:28:14 user devstack@n-api.service[61729]: X-User-Name: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:28:14 user devstack@n-api.service[61729]: method: > Apr 17 19:28:14 user devstack@n-api.service[61729]: exception: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61729]: action_args: {'id': 'c6f3e4c7-fbbd-4072-b568-a58a0eadde7b'} Apr 17 19:28:14 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Returning 404 to user: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:28:14 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6e18d12f-fe5d-496f-af04-f55f842ef7b2 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 404 len: 111 microversion: 2.1 time: 0.032362 Apr 17 19:28:14 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:28:14 2023] DELETE /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: c6f3e4c7-fbbd-4072-b568-a58a0eadde7b] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] HTTP exception thrown: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Request method failure captured: Apr 17 19:28:14 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b HTTP/1.1 Apr 17 19:28:14 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:28:14 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:28:14 user devstack@n-api.service[61727]: Connection: close Apr 17 19:28:14 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:28:14 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:28:14 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:28:14 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:28:14 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZvGx4lZw7BzTPxtO0iTp3eFn2_eSmj0ugKiIZCZmROgs8jgNLhHNGiKlNW5eiAh7kjy8TyIqseCT1oT_fo--oPKC8FsRXG0wTgBswjRsrYAlnV5VYwLQ6WHgq4m1SYMt6WegS3VwqvCzbUTjU6mSY13ibzp0tPd0tzqKceYelTWCNQ Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Project-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Tenant: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Tenant-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:28:14 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:28:14 user devstack@n-api.service[61727]: X-User: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:28:14 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:28:14 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:28:14 user devstack@n-api.service[61727]: X-User-Id: 82191afa221843d9ba371a0082792089 Apr 17 19:28:14 user devstack@n-api.service[61727]: X-User-Name: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:28:14 user devstack@n-api.service[61727]: method: > Apr 17 19:28:14 user devstack@n-api.service[61727]: exception: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61727]: action_args: {'id': 'c6f3e4c7-fbbd-4072-b568-a58a0eadde7b'} Apr 17 19:28:14 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. Apr 17 19:28:14 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:28:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Returning 404 to user: Instance c6f3e4c7-fbbd-4072-b568-a58a0eadde7b could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:28:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2647bcf7-30ff-40d0-b89d-50e75b9be93e tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b" status: 404 len: 111 microversion: 2.1 time: 0.055827 Apr 17 19:28:14 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:28:14 2023] GET /compute/v2.1/servers/c6f3e4c7-fbbd-4072-b568-a58a0eadde7b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:28:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-7c34d460-0892-4b9d-9749-33a62e6747ab tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 204 len: 0 microversion: 2.1 time: 0.116884 Apr 17 19:28:14 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 92/273] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:28:14 2023] DELETE /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:14 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:15 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-887d4171-5c78-406d-83cb-4ee9a1bc7738 req-9218859a-11f5-4ff8-a308-8587387eadec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de57ac54-e4d0-4d8c-89a7-af9af02af551", "name": "network-vif-unplugged", "status": "completed", "tag": "8f76ff77-7965-42e0-a9a9-b41fcbc01b5a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:28:15 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82191afa221843d9ba371a0082792089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b869ed530a4a77bda0e6ec61125c2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-887d4171-5c78-406d-83cb-4ee9a1bc7738 req-9218859a-11f5-4ff8-a308-8587387eadec service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-887d4171-5c78-406d-83cb-4ee9a1bc7738 req-9218859a-11f5-4ff8-a308-8587387eadec service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:15 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-887d4171-5c78-406d-83cb-4ee9a1bc7738 req-9218859a-11f5-4ff8-a308-8587387eadec service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:15 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-fbe2ec67-df7d-4bde-9bca-2053d1d48324 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 200 len: 1499 microversion: 2.1 time: 0.264209 Apr 17 19:28:15 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 92/274] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:28:14 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 1499 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:28:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-887d4171-5c78-406d-83cb-4ee9a1bc7738 req-9218859a-11f5-4ff8-a308-8587387eadec service nova] Creating event network-vif-unplugged:8f76ff77-7965-42e0-a9a9-b41fcbc01b5a for instance de57ac54-e4d0-4d8c-89a7-af9af02af551 on user Apr 17 19:28:15 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-887d4171-5c78-406d-83cb-4ee9a1bc7738 req-9218859a-11f5-4ff8-a308-8587387eadec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037964 Apr 17 19:28:15 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:28:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:28:16 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-50e0abc3-4cb7-49aa-975c-75e309f2088a req-b78144a0-08e8-43ef-8ca2-1cd77e809f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de57ac54-e4d0-4d8c-89a7-af9af02af551", "name": "network-vif-deleted", "tag": "8f76ff77-7965-42e0-a9a9-b41fcbc01b5a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:28:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-50e0abc3-4cb7-49aa-975c-75e309f2088a req-b78144a0-08e8-43ef-8ca2-1cd77e809f54 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-50e0abc3-4cb7-49aa-975c-75e309f2088a req-b78144a0-08e8-43ef-8ca2-1cd77e809f54 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:16 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-50e0abc3-4cb7-49aa-975c-75e309f2088a req-b78144a0-08e8-43ef-8ca2-1cd77e809f54 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-50e0abc3-4cb7-49aa-975c-75e309f2088a req-b78144a0-08e8-43ef-8ca2-1cd77e809f54 service nova] Creating event network-vif-deleted:8f76ff77-7965-42e0-a9a9-b41fcbc01b5a for instance de57ac54-e4d0-4d8c-89a7-af9af02af551 on user Apr 17 19:28:16 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-50e0abc3-4cb7-49aa-975c-75e309f2088a req-b78144a0-08e8-43ef-8ca2-1cd77e809f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028658 Apr 17 19:28:16 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 93/276] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:28:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:28:17 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-8a85170c-4f4e-4668-8dfd-a0828b06cf5a req-f7008813-e4e5-4be1-9dfd-b32bb31a26c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de57ac54-e4d0-4d8c-89a7-af9af02af551", "name": "network-vif-plugged", "status": "completed", "tag": "8f76ff77-7965-42e0-a9a9-b41fcbc01b5a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:28:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8a85170c-4f4e-4668-8dfd-a0828b06cf5a req-f7008813-e4e5-4be1-9dfd-b32bb31a26c8 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8a85170c-4f4e-4668-8dfd-a0828b06cf5a req-f7008813-e4e5-4be1-9dfd-b32bb31a26c8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8a85170c-4f4e-4668-8dfd-a0828b06cf5a req-f7008813-e4e5-4be1-9dfd-b32bb31a26c8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:17 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-8a85170c-4f4e-4668-8dfd-a0828b06cf5a req-f7008813-e4e5-4be1-9dfd-b32bb31a26c8 service nova] Creating event network-vif-plugged:8f76ff77-7965-42e0-a9a9-b41fcbc01b5a for instance de57ac54-e4d0-4d8c-89a7-af9af02af551 on user Apr 17 19:28:17 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-8a85170c-4f4e-4668-8dfd-a0828b06cf5a req-f7008813-e4e5-4be1-9dfd-b32bb31a26c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035280 Apr 17 19:28:17 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 93/277] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:28:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:20 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:21 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-de80e0fc-8075-4a6d-b1c8-0787e01d2411 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1656 microversion: 2.1 time: 0.212768 Apr 17 19:28:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 92/278] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:28:20 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1656 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:43 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec6b067a9748b28c34d3e4bc002215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd64d251bb4dd4a678262e95a3d0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bcaffe00-918c-4917-9a81-0b08fe50a856 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e" status: 200 len: 1570 microversion: 2.1 time: 0.227962 Apr 17 19:28:43 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:28:43 2023] GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=10 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-989448091"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=10 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:45 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:28:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-1b8c1b25-5597-4258-ace1-0dcf65c594f2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e" status: 204 len: 0 microversion: 2.1 time: 0.109794 Apr 17 19:28:45 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 93/280] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:28:44 2023] DELETE /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:45 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ec6b067a9748b28c34d3e4bc002215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4cd64d251bb4dd4a678262e95a3d0a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:45 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d46e3613-d516-44ce-a718-ca063b8a1e7a tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e" status: 200 len: 1576 microversion: 2.1 time: 0.175829 Apr 17 19:28:45 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 95/281] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:28:45 2023] GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:28:45 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-de5c27e8-665a-45f3-8658-0ddef5f1fa4c req-2f8b2511-5223-4a72-bea9-1e482314d0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67a686c-07b7-4438-af74-a8e5303dfe2e", "name": "network-vif-unplugged", "status": "completed", "tag": "4bf87be4-145d-4434-9975-e9b61471eab4"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:28:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-de5c27e8-665a-45f3-8658-0ddef5f1fa4c req-2f8b2511-5223-4a72-bea9-1e482314d0b1 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-de5c27e8-665a-45f3-8658-0ddef5f1fa4c req-2f8b2511-5223-4a72-bea9-1e482314d0b1 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:45 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-de5c27e8-665a-45f3-8658-0ddef5f1fa4c req-2f8b2511-5223-4a72-bea9-1e482314d0b1 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-de5c27e8-665a-45f3-8658-0ddef5f1fa4c req-2f8b2511-5223-4a72-bea9-1e482314d0b1 service nova] Creating event network-vif-unplugged:4bf87be4-145d-4434-9975-e9b61471eab4 for instance e67a686c-07b7-4438-af74-a8e5303dfe2e on user Apr 17 19:28:45 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-de5c27e8-665a-45f3-8658-0ddef5f1fa4c req-2f8b2511-5223-4a72-bea9-1e482314d0b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033143 Apr 17 19:28:45 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 94/282] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:28:45 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-f0e26ff1-ac7a-47e8-94cf-d57cba9a246b tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "POST /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e/action" status: 202 len: 52 microversion: 2.87 time: 0.921709 Apr 17 19:28:45 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 94/283] 10.0.0.210 () {66 vars in 1396 bytes} [Mon Apr 17 19:28:44 2023] POST /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e/action => generated 52 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 17 19:28:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e67a686c-07b7-4438-af74-a8e5303dfe2e", "name": "network-vif-plugged", "status": "completed", "tag": "4bf87be4-145d-4434-9975-e9b61471eab4"}, {"server_uuid": "e67a686c-07b7-4438-af74-a8e5303dfe2e", "name": "network-vif-deleted", "tag": "4bf87be4-145d-4434-9975-e9b61471eab4"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:28:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] Creating event network-vif-plugged:4bf87be4-145d-4434-9975-e9b61471eab4 for instance e67a686c-07b7-4438-af74-a8e5303dfe2e on user Apr 17 19:28:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] Creating event network-vif-deleted:4bf87be4-145d-4434-9975-e9b61471eab4 for instance e67a686c-07b7-4438-af74-a8e5303dfe2e on user Apr 17 19:28:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-f24022f9-c3dc-41d3-8c9a-a2fba69dec1a req-03ec3fee-db14-445e-a2b4-ae4e015861bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028106 Apr 17 19:28:47 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 96/284] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:28:50 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:28:51 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:51 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:51 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:28:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-4d32afb7-ab7f-467a-bd50-2d8b946f323c tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e" status: 200 len: 1690 microversion: 2.87 time: 0.219916 Apr 17 19:28:51 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 95/285] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:28:50 2023] GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e => generated 1690 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] [instance: de57ac54-e4d0-4d8c-89a7-af9af02af551] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:05 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] HTTP exception thrown: Instance de57ac54-e4d0-4d8c-89a7-af9af02af551 could not be found. Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Request method failure captured: Apr 17 19:29:05 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 HTTP/1.1 Apr 17 19:29:05 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:29:05 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:29:05 user devstack@n-api.service[61729]: Connection: close Apr 17 19:29:05 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:29:05 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:29:05 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:29:05 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:29:05 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZvGx4lZw7BzTPxtO0iTp3eFn2_eSmj0ugKiIZCZmROgs8jgNLhHNGiKlNW5eiAh7kjy8TyIqseCT1oT_fo--oPKC8FsRXG0wTgBswjRsrYAlnV5VYwLQ6WHgq4m1SYMt6WegS3VwqvCzbUTjU6mSY13ibzp0tPd0tzqKceYelTWCNQ Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Project-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Project-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/81b869ed530a4a77bda0e6ec61125c2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Tenant: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Tenant-Id: 81b869ed530a4a77bda0e6ec61125c2c Apr 17 19:29:05 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1995959237 Apr 17 19:29:05 user devstack@n-api.service[61729]: X-User: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:29:05 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:29:05 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:29:05 user devstack@n-api.service[61729]: X-User-Id: 82191afa221843d9ba371a0082792089 Apr 17 19:29:05 user devstack@n-api.service[61729]: X-User-Name: tempest-ServersNegativeTestJSON-1995959237-project-member Apr 17 19:29:05 user devstack@n-api.service[61729]: method: > Apr 17 19:29:05 user devstack@n-api.service[61729]: exception: Instance de57ac54-e4d0-4d8c-89a7-af9af02af551 could not be found. Apr 17 19:29:05 user devstack@n-api.service[61729]: action_args: {'id': 'de57ac54-e4d0-4d8c-89a7-af9af02af551'} Apr 17 19:29:05 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de57ac54-e4d0-4d8c-89a7-af9af02af551 could not be found. Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de57ac54-e4d0-4d8c-89a7-af9af02af551 could not be found. Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de57ac54-e4d0-4d8c-89a7-af9af02af551 could not be found. Apr 17 19:29:05 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:29:05 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] Returning 404 to user: Instance de57ac54-e4d0-4d8c-89a7-af9af02af551 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:29:05 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-76770d4f-75e5-44da-8548-24b885388618 tempest-ServersNegativeTestJSON-1995959237 tempest-ServersNegativeTestJSON-1995959237-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551" status: 404 len: 111 microversion: 2.1 time: 0.037078 Apr 17 19:29:05 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 95/286] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:29:05 2023] GET /compute/v2.1/servers/de57ac54-e4d0-4d8c-89a7-af9af02af551 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=14 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:08 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-d56f03de-dc85-44f5-a404-d768bad22ec8 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.177172 Apr 17 19:29:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:29:08 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46/os-interface => generated 283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:09 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-f5774d21-093b-4d17-ac1c-f06ab7a61478 req-fcae8679-4eaa-4a86-92ad-e3259fe86657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:09 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:09 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f5774d21-093b-4d17-ac1c-f06ab7a61478 req-fcae8679-4eaa-4a86-92ad-e3259fe86657 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f5774d21-093b-4d17-ac1c-f06ab7a61478 req-fcae8679-4eaa-4a86-92ad-e3259fe86657 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-f5774d21-093b-4d17-ac1c-f06ab7a61478 req-fcae8679-4eaa-4a86-92ad-e3259fe86657 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-f5774d21-093b-4d17-ac1c-f06ab7a61478 req-fcae8679-4eaa-4a86-92ad-e3259fe86657 service nova] Creating event network-changed:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:29:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-f5774d21-093b-4d17-ac1c-f06ab7a61478 req-fcae8679-4eaa-4a86-92ad-e3259fe86657 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036918 Apr 17 19:29:09 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 96/288] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:09 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-fcc61d0d-915f-4be4-a8b4-dad1299a408a tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46/ips" status: 200 len: 104 microversion: 2.1 time: 0.036988 Apr 17 19:29:09 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 96/289] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:29:09 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46/ips => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:10 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:29:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ec6f8009-d02c-4980-aa4d-df2dc05e64d1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 204 len: 0 microversion: 2.1 time: 0.112144 Apr 17 19:29:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 98/290] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:29:10 2023] DELETE /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:10 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6982f6dfac4e889b49f3d09b768ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '556ec6da247b4757b5f8919ad0c6f74f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:29:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8717bf43-e627-4753-a1a2-91eb5b34e347 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 200 len: 1663 microversion: 2.1 time: 0.270577 Apr 17 19:29:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 97/291] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:29:10 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 1663 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:29:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-614a0f54-4ba6-4979-aaee-6ceb2087447c req-8b4e782f-8e9b-4bec-9bf8-9a739147175b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "name": "network-vif-unplugged", "status": "completed", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-614a0f54-4ba6-4979-aaee-6ceb2087447c req-8b4e782f-8e9b-4bec-9bf8-9a739147175b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-614a0f54-4ba6-4979-aaee-6ceb2087447c req-8b4e782f-8e9b-4bec-9bf8-9a739147175b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-614a0f54-4ba6-4979-aaee-6ceb2087447c req-8b4e782f-8e9b-4bec-9bf8-9a739147175b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-614a0f54-4ba6-4979-aaee-6ceb2087447c req-8b4e782f-8e9b-4bec-9bf8-9a739147175b service nova] Creating event network-vif-unplugged:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:29:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-614a0f54-4ba6-4979-aaee-6ceb2087447c req-8b4e782f-8e9b-4bec-9bf8-9a739147175b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031662 Apr 17 19:29:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 97/292] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-7822c7d2-9867-40de-9fb0-3abc908956ce req-0c0f4c44-de15-4dab-b0d6-5c200b59699a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "name": "network-vif-deleted", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7822c7d2-9867-40de-9fb0-3abc908956ce req-0c0f4c44-de15-4dab-b0d6-5c200b59699a service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7822c7d2-9867-40de-9fb0-3abc908956ce req-0c0f4c44-de15-4dab-b0d6-5c200b59699a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7822c7d2-9867-40de-9fb0-3abc908956ce req-0c0f4c44-de15-4dab-b0d6-5c200b59699a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-7822c7d2-9867-40de-9fb0-3abc908956ce req-0c0f4c44-de15-4dab-b0d6-5c200b59699a service nova] Creating event network-vif-deleted:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:29:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-7822c7d2-9867-40de-9fb0-3abc908956ce req-0c0f4c44-de15-4dab-b0d6-5c200b59699a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034067 Apr 17 19:29:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 99/293] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:12 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-3793e2d0-7e6d-4a0f-bd53-5b62f826d018 req-9c616164-9955-42a0-aee2-53c3a9e8ac37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "159e8d5b-3396-46ef-a3d1-c628431c2b46", "name": "network-vif-plugged", "status": "completed", "tag": "cdf8a944-65d0-4239-88f3-f2a2aedc996f"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:12 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-3793e2d0-7e6d-4a0f-bd53-5b62f826d018 req-9c616164-9955-42a0-aee2-53c3a9e8ac37 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:12 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-3793e2d0-7e6d-4a0f-bd53-5b62f826d018 req-9c616164-9955-42a0-aee2-53c3a9e8ac37 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:12 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-3793e2d0-7e6d-4a0f-bd53-5b62f826d018 req-9c616164-9955-42a0-aee2-53c3a9e8ac37 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:12 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-3793e2d0-7e6d-4a0f-bd53-5b62f826d018 req-9c616164-9955-42a0-aee2-53c3a9e8ac37 service nova] Creating event network-vif-plugged:cdf8a944-65d0-4239-88f3-f2a2aedc996f for instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 on user Apr 17 19:29:12 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-3793e2d0-7e6d-4a0f-bd53-5b62f826d018 req-9c616164-9955-42a0-aee2-53c3a9e8ac37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027619 Apr 17 19:29:12 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 98/294] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-38c41d6a-f863-403b-aad8-3fe333f3ec8d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Action: 'create', calling method: .version_select at 0x7f84d1c26c20>, body: {"keypair": {"name": "tempest-keypair-230504393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKoh6btI1N8v02OAqoY73sk1NEtsxAEqVgZhSufp/5leO9PzsogoihJ2E0Af4OM1VrfjVkbXZY5dI3UFil25XylQnaL8FmA547R5sB8m4MdAkxf5hIfj3pIcb1OUN9xOpg=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:16 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-38c41d6a-f863-403b-aad8-3fe333f3ec8d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:29:16 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-38c41d6a-f863-403b-aad8-3fe333f3ec8d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for user 4418cca50c8240deb6176062f7857ba8 and project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:29:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-38c41d6a-f863-403b-aad8-3fe333f3ec8d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.193831 Apr 17 19:29:16 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 98/295] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:29:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:17 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-838608747", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2d7a0107-3c9c-45b6-b90e-d27573251b32"}], "security_groups": [{"name": "tempest-securitygroup--1796464064"}], "key_name": "tempest-keypair-230504393", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] validate_networks() for [('2d7a0107-3c9c-45b6-b90e-d27573251b32', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for user 4418cca50c8240deb6176062f7857ba8 and project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:29:18 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:29:18 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-08a3bb28-54a2-406b-87ce-f489f8063f46 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.774411 Apr 17 19:29:18 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 100/296] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:29:17 2023] POST /compute/v2.1/servers => generated 400 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:29:18 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-84acc3ed-d8d2-4e2f-98f3-9b3c5c7a358a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:18 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-84acc3ed-d8d2-4e2f-98f3-9b3c5c7a358a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:18 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-84acc3ed-d8d2-4e2f-98f3-9b3c5c7a358a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:29:18 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-84acc3ed-d8d2-4e2f-98f3-9b3c5c7a358a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 200 len: 1234 microversion: 2.1 time: 0.063263 Apr 17 19:29:18 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 99/297] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:29:18 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 1234 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:29:21 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=8 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:21 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-a73d03c3-1651-43d5-8c2e-9d26f93dac91 req-03fead01-aad3-49f3-8236-17c87ae6bf4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a73d03c3-1651-43d5-8c2e-9d26f93dac91 req-03fead01-aad3-49f3-8236-17c87ae6bf4e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a73d03c3-1651-43d5-8c2e-9d26f93dac91 req-03fead01-aad3-49f3-8236-17c87ae6bf4e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-a73d03c3-1651-43d5-8c2e-9d26f93dac91 req-03fead01-aad3-49f3-8236-17c87ae6bf4e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:21 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-a73d03c3-1651-43d5-8c2e-9d26f93dac91 req-03fead01-aad3-49f3-8236-17c87ae6bf4e service nova] Creating event network-changed:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:29:21 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-a73d03c3-1651-43d5-8c2e-9d26f93dac91 req-03fead01-aad3-49f3-8236-17c87ae6bf4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Apr 17 19:29:21 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 99/298] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:29:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-305ef9fd-2ba4-4a75-9571-fd2b15179727 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 204 len: 0 microversion: 2.1 time: 0.117225 Apr 17 19:29:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 101/299] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:29:21 2023] DELETE /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:21 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7139a40814447f4b88dd52668ecd59d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91deb1d3c8a24418a4521ae88a754125', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:29:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-3960bdd9-68c5-4e20-bf55-4267c651aa4a tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 200 len: 1662 microversion: 2.1 time: 0.305489 Apr 17 19:29:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 100/300] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:29:21 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 1662 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:29:22 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-7558865a-e05f-4b8c-bfaf-5fbc7efd87f5 req-57be2635-1a1e-45c6-a289-f11acaec718e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "name": "network-vif-unplugged", "status": "completed", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:22 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-7558865a-e05f-4b8c-bfaf-5fbc7efd87f5 req-57be2635-1a1e-45c6-a289-f11acaec718e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:22 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-7558865a-e05f-4b8c-bfaf-5fbc7efd87f5 req-57be2635-1a1e-45c6-a289-f11acaec718e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:22 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-7558865a-e05f-4b8c-bfaf-5fbc7efd87f5 req-57be2635-1a1e-45c6-a289-f11acaec718e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:22 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-7558865a-e05f-4b8c-bfaf-5fbc7efd87f5 req-57be2635-1a1e-45c6-a289-f11acaec718e service nova] Creating event network-vif-unplugged:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:29:22 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-7558865a-e05f-4b8c-bfaf-5fbc7efd87f5 req-57be2635-1a1e-45c6-a289-f11acaec718e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028780 Apr 17 19:29:22 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 100/301] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:23 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-c658b9da-1a3a-451e-9b46-78139948633f req-3cb90776-b60c-4fd5-b98b-4fa9ee39090d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "name": "network-vif-deleted", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c658b9da-1a3a-451e-9b46-78139948633f req-3cb90776-b60c-4fd5-b98b-4fa9ee39090d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c658b9da-1a3a-451e-9b46-78139948633f req-3cb90776-b60c-4fd5-b98b-4fa9ee39090d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:23 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-c658b9da-1a3a-451e-9b46-78139948633f req-3cb90776-b60c-4fd5-b98b-4fa9ee39090d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-ba4cb2dc-c47d-4df3-b24d-b73acf6c5887 req-ae9ee987-1d9b-4ce0-a159-fd0c7e8cb339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "name": "network-vif-plugged", "status": "completed", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ba4cb2dc-c47d-4df3-b24d-b73acf6c5887 req-ae9ee987-1d9b-4ce0-a159-fd0c7e8cb339 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ba4cb2dc-c47d-4df3-b24d-b73acf6c5887 req-ae9ee987-1d9b-4ce0-a159-fd0c7e8cb339 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ba4cb2dc-c47d-4df3-b24d-b73acf6c5887 req-ae9ee987-1d9b-4ce0-a159-fd0c7e8cb339 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-ba4cb2dc-c47d-4df3-b24d-b73acf6c5887 req-ae9ee987-1d9b-4ce0-a159-fd0c7e8cb339 service nova] Creating event network-vif-plugged:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:29:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-ba4cb2dc-c47d-4df3-b24d-b73acf6c5887 req-ae9ee987-1d9b-4ce0-a159-fd0c7e8cb339 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043636 Apr 17 19:29:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-c658b9da-1a3a-451e-9b46-78139948633f req-3cb90776-b60c-4fd5-b98b-4fa9ee39090d service nova] Creating event network-vif-deleted:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:29:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 17 19:29:23 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-c658b9da-1a3a-451e-9b46-78139948633f req-3cb90776-b60c-4fd5-b98b-4fa9ee39090d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062409 Apr 17 19:29:23 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 102/303] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:24 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-131831cf-be9b-4b71-a490-a6ecd66bc195 req-c7323682-0c07-4429-8fbc-7edb473f093d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8127b02c-63f1-482d-a98f-ab3c59a58c94", "name": "network-vif-plugged", "status": "completed", "tag": "ee684707-dc02-4078-8629-18ae33a8ee75"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-131831cf-be9b-4b71-a490-a6ecd66bc195 req-c7323682-0c07-4429-8fbc-7edb473f093d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-131831cf-be9b-4b71-a490-a6ecd66bc195 req-c7323682-0c07-4429-8fbc-7edb473f093d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:24 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-131831cf-be9b-4b71-a490-a6ecd66bc195 req-c7323682-0c07-4429-8fbc-7edb473f093d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:24 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-131831cf-be9b-4b71-a490-a6ecd66bc195 req-c7323682-0c07-4429-8fbc-7edb473f093d service nova] Creating event network-vif-plugged:ee684707-dc02-4078-8629-18ae33a8ee75 for instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 on user Apr 17 19:29:24 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-131831cf-be9b-4b71-a490-a6ecd66bc195 req-c7323682-0c07-4429-8fbc-7edb473f093d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028162 Apr 17 19:29:24 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 101/304] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:25 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-d6227ccf-1f79-4578-be61-14fd98ed48d0 req-8d3c5386-afc8-4237-9035-ec40b4d4a6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "name": "network-vif-plugged", "status": "completed", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d6227ccf-1f79-4578-be61-14fd98ed48d0 req-8d3c5386-afc8-4237-9035-ec40b4d4a6e1 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d6227ccf-1f79-4578-be61-14fd98ed48d0 req-8d3c5386-afc8-4237-9035-ec40b4d4a6e1 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:25 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d6227ccf-1f79-4578-be61-14fd98ed48d0 req-8d3c5386-afc8-4237-9035-ec40b4d4a6e1 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-d6227ccf-1f79-4578-be61-14fd98ed48d0 req-8d3c5386-afc8-4237-9035-ec40b4d4a6e1 service nova] Creating event network-vif-plugged:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:29:25 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-d6227ccf-1f79-4578-be61-14fd98ed48d0 req-8d3c5386-afc8-4237-9035-ec40b4d4a6e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 Apr 17 19:29:25 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 102/305] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] [instance: e67a686c-07b7-4438-af74-a8e5303dfe2e] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] HTTP exception thrown: Instance e67a686c-07b7-4438-af74-a8e5303dfe2e could not be found. Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Request method failure captured: Apr 17 19:29:35 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e HTTP/1.1 Apr 17 19:29:35 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:29:35 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:29:35 user devstack@n-api.service[61728]: Connection: close Apr 17 19:29:35 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:29:35 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:29:35 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:29:35 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:29:35 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ1yDLv2C8j-UPZKuvEc5NHMAUrSnPxR8sMITzmBZ9j7B7eIu3HGmJVZNrpKCp025UZzRQmqK7siBTtQui1amYjJhJsu1ukWerZ_JsoIjVY9k3U3t17z1ueFg_T7QB8zLYnXzLeR3pqXOdTlCU6U-JgP2z72_t_n0LO4IPTqYUmQnas Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Project-Id: e4cd64d251bb4dd4a678262e95a3d0a5 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Project-Name: tempest-SnapshotDataIntegrityTests-945301851 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e4cd64d251bb4dd4a678262e95a3d0a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4cd64d251bb4dd4a678262e95a3d0a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e4cd64d251bb4dd4a678262e95a3d0a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Tenant: tempest-SnapshotDataIntegrityTests-945301851 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Tenant-Id: e4cd64d251bb4dd4a678262e95a3d0a5 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-945301851 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-User: tempest-SnapshotDataIntegrityTests-945301851-project-member Apr 17 19:29:35 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:29:35 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:29:35 user devstack@n-api.service[61728]: X-User-Id: 20ec6b067a9748b28c34d3e4bc002215 Apr 17 19:29:35 user devstack@n-api.service[61728]: X-User-Name: tempest-SnapshotDataIntegrityTests-945301851-project-member Apr 17 19:29:35 user devstack@n-api.service[61728]: method: > Apr 17 19:29:35 user devstack@n-api.service[61728]: exception: Instance e67a686c-07b7-4438-af74-a8e5303dfe2e could not be found. Apr 17 19:29:35 user devstack@n-api.service[61728]: action_args: {'id': 'e67a686c-07b7-4438-af74-a8e5303dfe2e'} Apr 17 19:29:35 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e67a686c-07b7-4438-af74-a8e5303dfe2e could not be found. Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e67a686c-07b7-4438-af74-a8e5303dfe2e could not be found. Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e67a686c-07b7-4438-af74-a8e5303dfe2e could not be found. Apr 17 19:29:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:29:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Returning 404 to user: Instance e67a686c-07b7-4438-af74-a8e5303dfe2e could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:29:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c5cf05fe-1c88-43fe-9af1-7a9815d8a6a5 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e" status: 404 len: 111 microversion: 2.1 time: 0.039759 Apr 17 19:29:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:29:35 2023] GET /compute/v2.1/servers/e67a686c-07b7-4438-af74-a8e5303dfe2e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:29:35 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:35 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-ad0e3dfc-f8ec-4ad6-a7fa-fc99b46d3fe2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] Calling method '.version_select at 0x7f84d1c24d30>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:35 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-ad0e3dfc-f8ec-4ad6-a7fa-fc99b46d3fe2 tempest-SnapshotDataIntegrityTests-945301851 tempest-SnapshotDataIntegrityTests-945301851-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1273943855" status: 202 len: 0 microversion: 2.1 time: 0.025353 Apr 17 19:29:35 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 102/307] 10.0.0.210 () {62 vars in 1355 bytes} [Mon Apr 17 19:29:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1273943855 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:29:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=16 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:51 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=20 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:51 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2035806341", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "003f99eb-9d8f-4734-989c-fb7e29875453", "destination_type": "volume"}], "networks": [{"uuid": "e7a6280a-93ff-4c57-8b63-ab13755c3ae2"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:51 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] validate_networks() for [('e7a6280a-93ff-4c57-8b63-ab13755c3ae2', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Getting quotas for user 564b229ded9c40dfa3a6afc15663c832 and project 99dac87706794aafbb9794b3b4f863c4. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:29:52 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:29:52 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-22ac2bf5-dce7-44fa-99d8-aee74c33b647 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.577103 Apr 17 19:29:52 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 103/308] 10.0.0.210 () {66 vars in 1265 bytes} [Mon Apr 17 19:29:51 2023] POST /compute/v2.1/servers => generated 378 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-82970201-2755-4398-8b63-01415b214e50 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-82970201-2755-4398-8b63-01415b214e50 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-82970201-2755-4398-8b63-01415b214e50 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-82970201-2755-4398-8b63-01415b214e50 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:29:52 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-82970201-2755-4398-8b63-01415b214e50 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:29:52 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-82970201-2755-4398-8b63-01415b214e50 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f" status: 200 len: 1395 microversion: 2.87 time: 0.075938 Apr 17 19:29:52 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:29:52 2023] GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f => generated 1395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:29:54 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:29:54 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-565d6478-cd48-485d-a1bc-e393de1229ec req-0c475644-c48b-4d0f-9e04-77e58d0896c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f", "tag": "23addbca-1089-4649-8ff3-dbbee4717366"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:54 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-565d6478-cd48-485d-a1bc-e393de1229ec req-0c475644-c48b-4d0f-9e04-77e58d0896c9 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:54 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-565d6478-cd48-485d-a1bc-e393de1229ec req-0c475644-c48b-4d0f-9e04-77e58d0896c9 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:54 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-565d6478-cd48-485d-a1bc-e393de1229ec req-0c475644-c48b-4d0f-9e04-77e58d0896c9 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:54 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-565d6478-cd48-485d-a1bc-e393de1229ec req-0c475644-c48b-4d0f-9e04-77e58d0896c9 service nova] Creating event network-changed:23addbca-1089-4649-8ff3-dbbee4717366 for instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f on user Apr 17 19:29:54 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-565d6478-cd48-485d-a1bc-e393de1229ec req-0c475644-c48b-4d0f-9e04-77e58d0896c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033035 Apr 17 19:29:54 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 103/310] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:29:59 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-d3220d40-cb16-4aaf-9069-ddb60c64bcee req-8ad40067-52da-4011-b4ca-39cb9bfda25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f", "name": "network-vif-deleted", "tag": "23addbca-1089-4649-8ff3-dbbee4717366"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:29:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d3220d40-cb16-4aaf-9069-ddb60c64bcee req-8ad40067-52da-4011-b4ca-39cb9bfda25c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:29:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d3220d40-cb16-4aaf-9069-ddb60c64bcee req-8ad40067-52da-4011-b4ca-39cb9bfda25c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:29:59 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-d3220d40-cb16-4aaf-9069-ddb60c64bcee req-8ad40067-52da-4011-b4ca-39cb9bfda25c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:29:59 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.compute.server_external_events [req-d3220d40-cb16-4aaf-9069-ddb60c64bcee req-8ad40067-52da-4011-b4ca-39cb9bfda25c service nova] Unable to find a host for instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f. Dropping event network-vif-deleted {{(pid=61727) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 17 19:29:59 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-d3220d40-cb16-4aaf-9069-ddb60c64bcee req-8ad40067-52da-4011-b4ca-39cb9bfda25c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027670 Apr 17 19:29:59 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 104/311] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:29:59 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] HTTP exception thrown: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Request method failure captured: Apr 17 19:30:01 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 HTTP/1.1 Apr 17 19:30:01 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:30:01 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:30:01 user devstack@n-api.service[61728]: Connection: close Apr 17 19:30:01 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:30:01 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:30:01 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:30:01 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:30:01 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZztjyIjPcZmYI3o17TAnQmIrUGsTF2NDOXWIq5XSFM3xur6SA5k4iBsHK1gA0n_6fznIYFZG-bf7ndyhkKr1TTib2yLnPPPNhoq4CqQc9mYBRhyLqa5NFdBOc8Dq80pSPQlaDDvxo7BJ_Rmyk9N3UDFpa8YyTnC3ozQ1YpQWf14ItE Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Tenant-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Id: be6982f6dfac4e889b49f3d09b768ab9 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:01 user devstack@n-api.service[61728]: method: > Apr 17 19:30:01 user devstack@n-api.service[61728]: exception: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: action_args: {'id': '159e8d5b-3396-46ef-a3d1-c628431c2b46'} Apr 17 19:30:01 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Returning 404 to user: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c2ad88b8-2917-4bef-8a07-cf667382d47b tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 404 len: 111 microversion: 2.1 time: 0.121481 Apr 17 19:30:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 105/312] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:30:00 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:01 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-c33df1e9-9deb-450e-b069-28212625c3db tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '.version_select at 0x7f84d1c26ef0>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:01 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-c33df1e9-9deb-450e-b069-28212625c3db tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216049893" status: 202 len: 0 microversion: 2.1 time: 0.021169 Apr 17 19:30:01 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 104/313] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:30:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1216049893 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] HTTP exception thrown: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Request method failure captured: Apr 17 19:30:01 user devstack@n-api.service[61727]: request: DELETE /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 HTTP/1.1 Apr 17 19:30:01 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:30:01 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:30:01 user devstack@n-api.service[61727]: Connection: close Apr 17 19:30:01 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:30:01 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:30:01 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:30:01 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:30:01 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZztjyIjPcZmYI3o17TAnQmIrUGsTF2NDOXWIq5XSFM3xur6SA5k4iBsHK1gA0n_6fznIYFZG-bf7ndyhkKr1TTib2yLnPPPNhoq4CqQc9mYBRhyLqa5NFdBOc8Dq80pSPQlaDDvxo7BJ_Rmyk9N3UDFpa8YyTnC3ozQ1YpQWf14ItE Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Project-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Tenant-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:01 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:01 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:30:01 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:30:01 user devstack@n-api.service[61727]: X-User-Id: be6982f6dfac4e889b49f3d09b768ab9 Apr 17 19:30:01 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:01 user devstack@n-api.service[61727]: method: > Apr 17 19:30:01 user devstack@n-api.service[61727]: exception: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61727]: action_args: {'id': '159e8d5b-3396-46ef-a3d1-c628431c2b46'} Apr 17 19:30:01 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Returning 404 to user: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-126b8757-9ee4-48d7-b867-2522a97b1062 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 404 len: 111 microversion: 2.1 time: 0.027950 Apr 17 19:30:01 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:30:01 2023] DELETE /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 159e8d5b-3396-46ef-a3d1-c628431c2b46] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] HTTP exception thrown: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Request method failure captured: Apr 17 19:30:01 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 HTTP/1.1 Apr 17 19:30:01 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:30:01 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:30:01 user devstack@n-api.service[61728]: Connection: close Apr 17 19:30:01 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:30:01 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:30:01 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:30:01 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:30:01 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZztjyIjPcZmYI3o17TAnQmIrUGsTF2NDOXWIq5XSFM3xur6SA5k4iBsHK1gA0n_6fznIYFZG-bf7ndyhkKr1TTib2yLnPPPNhoq4CqQc9mYBRhyLqa5NFdBOc8Dq80pSPQlaDDvxo7BJ_Rmyk9N3UDFpa8YyTnC3ozQ1YpQWf14ItE Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Tenant-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:01 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Id: be6982f6dfac4e889b49f3d09b768ab9 Apr 17 19:30:01 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:01 user devstack@n-api.service[61728]: method: > Apr 17 19:30:01 user devstack@n-api.service[61728]: exception: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: action_args: {'id': '159e8d5b-3396-46ef-a3d1-c628431c2b46'} Apr 17 19:30:01 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. Apr 17 19:30:01 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Returning 404 to user: Instance 159e8d5b-3396-46ef-a3d1-c628431c2b46 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ed067d38-03f6-4fcd-9bd3-ae39b962f0f7 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46" status: 404 len: 111 microversion: 2.1 time: 0.026378 Apr 17 19:30:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:30:01 2023] GET /compute/v2.1/servers/159e8d5b-3396-46ef-a3d1-c628431c2b46 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:02 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] HTTP exception thrown: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Request method failure captured: Apr 17 19:30:02 user devstack@n-api.service[61729]: request: DELETE /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 HTTP/1.1 Apr 17 19:30:02 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:30:02 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:30:02 user devstack@n-api.service[61729]: Connection: close Apr 17 19:30:02 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:30:02 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:30:02 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:30:02 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:30:02 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZztjyIjPcZmYI3o17TAnQmIrUGsTF2NDOXWIq5XSFM3xur6SA5k4iBsHK1gA0n_6fznIYFZG-bf7ndyhkKr1TTib2yLnPPPNhoq4CqQc9mYBRhyLqa5NFdBOc8Dq80pSPQlaDDvxo7BJ_Rmyk9N3UDFpa8YyTnC3ozQ1YpQWf14ItE Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Project-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Project-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Tenant: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Tenant-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:02 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:02 user devstack@n-api.service[61729]: X-User: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:02 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:30:02 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:30:02 user devstack@n-api.service[61729]: X-User-Id: be6982f6dfac4e889b49f3d09b768ab9 Apr 17 19:30:02 user devstack@n-api.service[61729]: X-User-Name: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:02 user devstack@n-api.service[61729]: method: > Apr 17 19:30:02 user devstack@n-api.service[61729]: exception: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61729]: action_args: {'id': '756691bf-01bc-480e-b3cb-182020386354'} Apr 17 19:30:02 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Returning 404 to user: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:02 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-877aafac-e20e-4b8f-bc08-824f792e5351 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 404 len: 111 microversion: 2.1 time: 0.027787 Apr 17 19:30:02 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 105/316] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:30:02 2023] DELETE /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] [instance: 756691bf-01bc-480e-b3cb-182020386354] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] HTTP exception thrown: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Request method failure captured: Apr 17 19:30:02 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 HTTP/1.1 Apr 17 19:30:02 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:30:02 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:30:02 user devstack@n-api.service[61727]: Connection: close Apr 17 19:30:02 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:30:02 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:30:02 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:30:02 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:30:02 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZztjyIjPcZmYI3o17TAnQmIrUGsTF2NDOXWIq5XSFM3xur6SA5k4iBsHK1gA0n_6fznIYFZG-bf7ndyhkKr1TTib2yLnPPPNhoq4CqQc9mYBRhyLqa5NFdBOc8Dq80pSPQlaDDvxo7BJ_Rmyk9N3UDFpa8YyTnC3ozQ1YpQWf14ItE Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Project-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/556ec6da247b4757b5f8919ad0c6f74f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Tenant-Id: 556ec6da247b4757b5f8919ad0c6f74f Apr 17 19:30:02 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1499959843 Apr 17 19:30:02 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:02 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:30:02 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:30:02 user devstack@n-api.service[61727]: X-User-Id: be6982f6dfac4e889b49f3d09b768ab9 Apr 17 19:30:02 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeTestJSON-1499959843-project-member Apr 17 19:30:02 user devstack@n-api.service[61727]: method: > Apr 17 19:30:02 user devstack@n-api.service[61727]: exception: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61727]: action_args: {'id': '756691bf-01bc-480e-b3cb-182020386354'} Apr 17 19:30:02 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. Apr 17 19:30:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] Returning 404 to user: Instance 756691bf-01bc-480e-b3cb-182020386354 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-6ed693c9-8b84-4dac-8fbb-3df21391ccf1 tempest-AttachVolumeTestJSON-1499959843 tempest-AttachVolumeTestJSON-1499959843-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354" status: 404 len: 111 microversion: 2.1 time: 0.026330 Apr 17 19:30:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 106/317] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:30:02 2023] GET /compute/v2.1/servers/756691bf-01bc-480e-b3cb-182020386354 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:06 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:06 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-56e10536-6bdd-47f2-9b61-0a93073baaa9 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Action: 'create', calling method: .version_select at 0x7f84d1d18820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1870805510"}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:06 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-56e10536-6bdd-47f2-9b61-0a93073baaa9 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.419333 Apr 17 19:30:06 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 107/318] 10.0.0.210 () {64 vars in 1232 bytes} [Mon Apr 17 19:30:06 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 421 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 17 19:30:07 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-12ae9001-f9eb-4f8e-9772-0aa436c59a18 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Calling method '.version_select at 0x7f84d1c26950>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:07 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-12ae9001-f9eb-4f8e-9772-0aa436c59a18 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413" status: 200 len: 342 microversion: 2.1 time: 0.196209 Apr 17 19:30:07 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 106/319] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:30:06 2023] GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413 => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-5ed403ee-519f-4baf-9479-70c399c264d9 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Calling method '.version_select at 0x7f84d1ed5ea0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:08 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-5ed403ee-519f-4baf-9479-70c399c264d9 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413" status: 200 len: 342 microversion: 2.1 time: 0.052450 Apr 17 19:30:08 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 107/320] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:30:08 2023] GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413 => generated 342 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:30:08 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-470ed283-3a99-4304-93f0-d72653ba3769 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Calling method '.version_select at 0x7f84d1eeed40>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:08 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-470ed283-3a99-4304-93f0-d72653ba3769 tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413" status: 202 len: 0 microversion: 2.1 time: 0.110086 Apr 17 19:30:08 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 108/321] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:30:08 2023] DELETE /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:30:08 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6193127e-3ae0-4615-979d-16df4c02553b tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Calling method '.version_select at 0x7f84d1c24ca0>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:08 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-6193127e-3ae0-4615-979d-16df4c02553b tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] HTTP exception thrown: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. Apr 17 19:30:08 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6193127e-3ae0-4615-979d-16df4c02553b tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Request method failure captured: Apr 17 19:30:08 user devstack@n-api.service[61729]: request: GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413 HTTP/1.1 Apr 17 19:30:08 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:30:08 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:30:08 user devstack@n-api.service[61729]: Connection: close Apr 17 19:30:08 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:30:08 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:30:08 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:30:08 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:30:08 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZ4-mHlc2VVubd2IYVnyVhBvaaizOXTo_lim_aR-9SwZ42FtdCvUsKBdDxKiw-48GDHVZcNb_Qiygw_Xa3pYPlrAPEUv-e98TQ3VoWZ61ymyHu9HEEcxe44OTO0873TBpb12LkPiH3vZH8R1g78gewQMxlUEdiCC9_APB54gckqO6O4 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Project-Id: df1a1627c01b4335aaa0f543bb360334 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-125159084 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/df1a1627c01b4335aaa0f543bb360334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df1a1627c01b4335aaa0f543bb360334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/df1a1627c01b4335aaa0f543bb360334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Tenant: tempest-VolumesSnapshotsTestJSON-125159084 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Tenant-Id: df1a1627c01b4335aaa0f543bb360334 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-125159084 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-User: tempest-VolumesSnapshotsTestJSON-125159084-project-member Apr 17 19:30:08 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:30:08 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:30:08 user devstack@n-api.service[61729]: X-User-Id: 505782d792f44ac29ff3af7f1cf576a6 Apr 17 19:30:08 user devstack@n-api.service[61729]: X-User-Name: tempest-VolumesSnapshotsTestJSON-125159084-project-member Apr 17 19:30:08 user devstack@n-api.service[61729]: method: Apr 17 19:30:08 user devstack@n-api.service[61729]: exception: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. Apr 17 19:30:08 user devstack@n-api.service[61729]: action_args: {'id': '9e52fdc8-e601-4268-98cf-5bae938dd413'} Apr 17 19:30:08 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. (HTTP 404) (Request-ID: req-2bf978f4-d30d-4bcb-93bf-d5e63a2446eb) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. Apr 17 19:30:08 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:08 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6193127e-3ae0-4615-979d-16df4c02553b tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] Returning 404 to user: Volume 9e52fdc8-e601-4268-98cf-5bae938dd413 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:08 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6193127e-3ae0-4615-979d-16df4c02553b tempest-VolumesSnapshotsTestJSON-125159084 tempest-VolumesSnapshotsTestJSON-125159084-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413" status: 404 len: 109 microversion: 2.1 time: 0.039717 Apr 17 19:30:08 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 107/322] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:30:08 2023] GET /compute/v2.1/os-volumes/9e52fdc8-e601-4268-98cf-5bae938dd413 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:08 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:09 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b4cce6b2-2503-49a2-a015-89ce59a6ce60 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 200 len: 1545 microversion: 2.1 time: 0.273204 Apr 17 19:30:09 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 108/323] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:30:08 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 1545 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ccb63ab7-7330-4f32-976b-216da917b9b2 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Action: 'create', calling method: .version_select at 0x7f84d1d1a440>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1616494897", "metadata": {"Type": "work"}}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ccb63ab7-7330-4f32-976b-216da917b9b2 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Request method failure captured: Apr 17 19:30:10 user devstack@n-api.service[61728]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 17 19:30:10 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:30:10 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:30:10 user devstack@n-api.service[61728]: Connection: close Apr 17 19:30:10 user devstack@n-api.service[61728]: Content-Length: 122 Apr 17 19:30:10 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:30:10 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:30:10 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:30:10 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ5Bk-THdtavFkPy3a1Lz6gsRTsdFTl64gCX3xMdvyuJWjlq6-_M2Y3lEr7H-q1io65Z67wVPt3JlU1mAEdG0TghCqQieyvFsQ7ZiuvRO-wTP_5rO7Zt2JHcowOMnPDR1x8zAT5ImfmvSNIKY0CgfpKqtOB6iv8cAoUx5EzYbt_f-eY Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ada4137d36674091a7781514d787e34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Id: ae7012475081442aa881b445d0d4cc5f Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Name: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61728]: Apr 17 19:30:10 user devstack@n-api.service[61728]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1616494897", "metadata": {"Type": "work"}}} Apr 17 19:30:10 user devstack@n-api.service[61728]: method: Apr 17 19:30:10 user devstack@n-api.service[61728]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61728]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1616494897', 'metadata': {'Type': 'work'}}}} Apr 17 19:30:10 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise error Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi '#$%' Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ccb63ab7-7330-4f32-976b-216da917b9b2 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ccb63ab7-7330-4f32-976b-216da917b9b2 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181211 Apr 17 19:30:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 109/324] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 19:30:10 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a5ea6461-b28d-4221-957c-172cfb47b4ea tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Action: 'create', calling method: .version_select at 0x7f84d1d95360>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-169500183", "metadata": {"Type": "work"}}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a5ea6461-b28d-4221-957c-172cfb47b4ea tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Request method failure captured: Apr 17 19:30:10 user devstack@n-api.service[61729]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 17 19:30:10 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:30:10 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:30:10 user devstack@n-api.service[61729]: Connection: close Apr 17 19:30:10 user devstack@n-api.service[61729]: Content-Length: 119 Apr 17 19:30:10 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:30:10 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:30:10 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:30:10 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZ5Bk-THdtavFkPy3a1Lz6gsRTsdFTl64gCX3xMdvyuJWjlq6-_M2Y3lEr7H-q1io65Z67wVPt3JlU1mAEdG0TghCqQieyvFsQ7ZiuvRO-wTP_5rO7Zt2JHcowOMnPDR1x8zAT5ImfmvSNIKY0CgfpKqtOB6iv8cAoUx5EzYbt_f-eY Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ada4137d36674091a7781514d787e34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Tenant: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Tenant-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Id: ae7012475081442aa881b445d0d4cc5f Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Name: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61729]: Apr 17 19:30:10 user devstack@n-api.service[61729]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-169500183", "metadata": {"Type": "work"}}} Apr 17 19:30:10 user devstack@n-api.service[61729]: method: Apr 17 19:30:10 user devstack@n-api.service[61729]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 17 19:30:10 user devstack@n-api.service[61729]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-169500183', 'metadata': {'Type': 'work'}}}} Apr 17 19:30:10 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise error Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi '0' Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-a5ea6461-b28d-4221-957c-172cfb47b4ea tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-a5ea6461-b28d-4221-957c-172cfb47b4ea tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009784 Apr 17 19:30:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 108/325] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 19:30:10 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-45f32f6c-08f3-4818-9da3-bc96803dee3f tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Action: 'create', calling method: .version_select at 0x7f84d1d64ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-683408693", "metadata": {"Type": "work"}}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-45f32f6c-08f3-4818-9da3-bc96803dee3f tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Request method failure captured: Apr 17 19:30:10 user devstack@n-api.service[61727]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 17 19:30:10 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:30:10 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:30:10 user devstack@n-api.service[61727]: Connection: close Apr 17 19:30:10 user devstack@n-api.service[61727]: Content-Length: 118 Apr 17 19:30:10 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:30:10 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:30:10 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:30:10 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZ5Bk-THdtavFkPy3a1Lz6gsRTsdFTl64gCX3xMdvyuJWjlq6-_M2Y3lEr7H-q1io65Z67wVPt3JlU1mAEdG0TghCqQieyvFsQ7ZiuvRO-wTP_5rO7Zt2JHcowOMnPDR1x8zAT5ImfmvSNIKY0CgfpKqtOB6iv8cAoUx5EzYbt_f-eY Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Project-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Project-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ada4137d36674091a7781514d787e34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Tenant: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Tenant-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61727]: X-User: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61727]: X-User-Id: ae7012475081442aa881b445d0d4cc5f Apr 17 19:30:10 user devstack@n-api.service[61727]: X-User-Name: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61727]: Apr 17 19:30:10 user devstack@n-api.service[61727]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-683408693", "metadata": {"Type": "work"}}} Apr 17 19:30:10 user devstack@n-api.service[61727]: method: Apr 17 19:30:10 user devstack@n-api.service[61727]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61727]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-683408693', 'metadata': {'Type': 'work'}}}} Apr 17 19:30:10 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise error Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi '' Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 17 19:30:10 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-45f32f6c-08f3-4818-9da3-bc96803dee3f tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-45f32f6c-08f3-4818-9da3-bc96803dee3f tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012006 Apr 17 19:30:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 109/326] 10.0.0.210 () {64 vars in 1233 bytes} [Mon Apr 17 19:30:10 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5380aa00-5787-4889-a486-1979dcf51f63 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Calling method '.version_select at 0x7f84d1d1b0a0>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-5380aa00-5787-4889-a486-1979dcf51f63 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] HTTP exception thrown: Volume tempest-invalid-446389936 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5380aa00-5787-4889-a486-1979dcf51f63 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Request method failure captured: Apr 17 19:30:10 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-446389936 HTTP/1.1 Apr 17 19:30:10 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:30:10 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:30:10 user devstack@n-api.service[61728]: Connection: close Apr 17 19:30:10 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:30:10 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:30:10 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:30:10 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:30:10 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ5Bk-THdtavFkPy3a1Lz6gsRTsdFTl64gCX3xMdvyuJWjlq6-_M2Y3lEr7H-q1io65Z67wVPt3JlU1mAEdG0TghCqQieyvFsQ7ZiuvRO-wTP_5rO7Zt2JHcowOMnPDR1x8zAT5ImfmvSNIKY0CgfpKqtOB6iv8cAoUx5EzYbt_f-eY Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ada4137d36674091a7781514d787e34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Id: ae7012475081442aa881b445d0d4cc5f Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Name: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61728]: method: Apr 17 19:30:10 user devstack@n-api.service[61728]: exception: Volume tempest-invalid-446389936 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: action_args: {'id': 'tempest-invalid-446389936'} Apr 17 19:30:10 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-446389936 could not be found. (HTTP 404) (Request-ID: req-6a8d4328-7bc1-45c3-ba8f-b79c1b8aecc8) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-446389936 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-446389936 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-446389936 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-5380aa00-5787-4889-a486-1979dcf51f63 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Returning 404 to user: Volume tempest-invalid-446389936 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-5380aa00-5787-4889-a486-1979dcf51f63 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-446389936" status: 404 len: 98 microversion: 2.1 time: 0.037987 Apr 17 19:30:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1292 bytes} [Mon Apr 17 19:30:10 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-446389936 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-3a39b44f-6823-4d4c-b1e8-9a7f7431d607 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003532 Apr 17 19:30:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 109/328] 10.0.0.210 () {62 vars in 1217 bytes} [Mon Apr 17 19:30:10 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c6d8f32b-72fe-43a0-9944-05f119446847 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003458 Apr 17 19:30:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1214 bytes} [Mon Apr 17 19:30:10 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cae04afd-f786-4904-b433-82688eb2385d tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Calling method '.version_select at 0x7f84d1eec550>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-cae04afd-f786-4904-b433-82688eb2385d tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] HTTP exception thrown: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cae04afd-f786-4904-b433-82688eb2385d tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Request method failure captured: Apr 17 19:30:10 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/os-volumes/f6d47921-3de7-40dd-a93e-29df50deb093 HTTP/1.1 Apr 17 19:30:10 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:30:10 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:30:10 user devstack@n-api.service[61728]: Connection: close Apr 17 19:30:10 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:30:10 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:30:10 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:30:10 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:30:10 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ5Bk-THdtavFkPy3a1Lz6gsRTsdFTl64gCX3xMdvyuJWjlq6-_M2Y3lEr7H-q1io65Z67wVPt3JlU1mAEdG0TghCqQieyvFsQ7ZiuvRO-wTP_5rO7Zt2JHcowOMnPDR1x8zAT5ImfmvSNIKY0CgfpKqtOB6iv8cAoUx5EzYbt_f-eY Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Project-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ada4137d36674091a7781514d787e34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Id: ae7012475081442aa881b445d0d4cc5f Apr 17 19:30:10 user devstack@n-api.service[61728]: X-User-Name: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61728]: method: Apr 17 19:30:10 user devstack@n-api.service[61728]: exception: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: action_args: {'id': 'f6d47921-3de7-40dd-a93e-29df50deb093'} Apr 17 19:30:10 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. (HTTP 404) (Request-ID: req-d267fce8-d1b9-48e3-97ad-3aba36fd65e9) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-cae04afd-f786-4904-b433-82688eb2385d tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Returning 404 to user: Volume f6d47921-3de7-40dd-a93e-29df50deb093 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-cae04afd-f786-4904-b433-82688eb2385d tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f6d47921-3de7-40dd-a93e-29df50deb093" status: 404 len: 109 microversion: 2.1 time: 0.038670 Apr 17 19:30:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:30:10 2023] DELETE /compute/v2.1/os-volumes/f6d47921-3de7-40dd-a93e-29df50deb093 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-dfe49243-596d-4958-a3d2-21a24f260868 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Calling method '.version_select at 0x7f84d1c25480>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-dfe49243-596d-4958-a3d2-21a24f260868 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] HTTP exception thrown: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-dfe49243-596d-4958-a3d2-21a24f260868 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Request method failure captured: Apr 17 19:30:10 user devstack@n-api.service[61729]: request: GET /compute/v2.1/os-volumes/ced8f746-8f50-429b-821b-54edca6235e1 HTTP/1.1 Apr 17 19:30:10 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:30:10 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:30:10 user devstack@n-api.service[61729]: Connection: close Apr 17 19:30:10 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:30:10 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:30:10 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:30:10 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:30:10 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZ5Bk-THdtavFkPy3a1Lz6gsRTsdFTl64gCX3xMdvyuJWjlq6-_M2Y3lEr7H-q1io65Z67wVPt3JlU1mAEdG0TghCqQieyvFsQ7ZiuvRO-wTP_5rO7Zt2JHcowOMnPDR1x8zAT5ImfmvSNIKY0CgfpKqtOB6iv8cAoUx5EzYbt_f-eY Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Project-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ada4137d36674091a7781514d787e34b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ada4137d36674091a7781514d787e34b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Tenant: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Tenant-Id: ada4137d36674091a7781514d787e34b Apr 17 19:30:10 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-VolumesNegativeTest-360919275 Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Id: ae7012475081442aa881b445d0d4cc5f Apr 17 19:30:10 user devstack@n-api.service[61729]: X-User-Name: tempest-VolumesNegativeTest-360919275-project-member Apr 17 19:30:10 user devstack@n-api.service[61729]: method: Apr 17 19:30:10 user devstack@n-api.service[61729]: exception: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61729]: action_args: {'id': 'ced8f746-8f50-429b-821b-54edca6235e1'} Apr 17 19:30:10 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. (HTTP 404) (Request-ID: req-bfeaf98e-f938-4c00-9eb7-40f34a8115f0) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. Apr 17 19:30:10 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:30:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-dfe49243-596d-4958-a3d2-21a24f260868 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] Returning 404 to user: Volume ced8f746-8f50-429b-821b-54edca6235e1 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-dfe49243-596d-4958-a3d2-21a24f260868 tempest-VolumesNegativeTest-360919275 tempest-VolumesNegativeTest-360919275-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ced8f746-8f50-429b-821b-54edca6235e1" status: 404 len: 109 microversion: 2.1 time: 0.036135 Apr 17 19:30:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 110/331] 10.0.0.210 () {62 vars in 1322 bytes} [Mon Apr 17 19:30:10 2023] GET /compute/v2.1/os-volumes/ced8f746-8f50-429b-821b-54edca6235e1 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] [instance: 8127b02c-63f1-482d-a98f-ab3c59a58c94] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] HTTP exception thrown: Instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 could not be found. Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Request method failure captured: Apr 17 19:30:11 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 HTTP/1.1 Apr 17 19:30:11 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:30:11 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:30:11 user devstack@n-api.service[61727]: Connection: close Apr 17 19:30:11 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:30:11 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:30:11 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:30:11 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:30:11 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZv8_yP-aeRtvPsP-VOUJLWeY9qpsT7dWHlqkFW7K7xn8XnkHp4669I5si46zCuzhxk7M5_cBLNcdmcQz7v7rfsZz2-1Otp-dj-cQcG6xDREbdLW4TUCluA8NJ6kMlbzaxopQ-1FIPZgQnlr0LKvzw6fxaEXFzVVJRY2m2OO8fXP5DE Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Project-Id: 91deb1d3c8a24418a4521ae88a754125 Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServerActionsTestJSON-644666636 Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91deb1d3c8a24418a4521ae88a754125"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91deb1d3c8a24418a4521ae88a754125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91deb1d3c8a24418a4521ae88a754125"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Tenant: tempest-ServerActionsTestJSON-644666636 Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Tenant-Id: 91deb1d3c8a24418a4521ae88a754125 Apr 17 19:30:11 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServerActionsTestJSON-644666636 Apr 17 19:30:11 user devstack@n-api.service[61727]: X-User: tempest-ServerActionsTestJSON-644666636-project-member Apr 17 19:30:11 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:30:11 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:30:11 user devstack@n-api.service[61727]: X-User-Id: c7139a40814447f4b88dd52668ecd59d Apr 17 19:30:11 user devstack@n-api.service[61727]: X-User-Name: tempest-ServerActionsTestJSON-644666636-project-member Apr 17 19:30:11 user devstack@n-api.service[61727]: method: > Apr 17 19:30:11 user devstack@n-api.service[61727]: exception: Instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 could not be found. Apr 17 19:30:11 user devstack@n-api.service[61727]: action_args: {'id': '8127b02c-63f1-482d-a98f-ab3c59a58c94'} Apr 17 19:30:11 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 could not be found. Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 could not be found. Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 could not be found. Apr 17 19:30:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:30:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Returning 404 to user: Instance 8127b02c-63f1-482d-a98f-ab3c59a58c94 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c8e74fe7-d5df-466c-8a90-f9094ced14af tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94" status: 404 len: 111 microversion: 2.1 time: 0.034671 Apr 17 19:30:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 111/332] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:30:11 2023] GET /compute/v2.1/servers/8127b02c-63f1-482d-a98f-ab3c59a58c94 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:30:11 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-408e6065-cb99-498b-b873-fe0f9fdca1e1 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] Calling method '.version_select at 0x7f84d3226830>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:11 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-408e6065-cb99-498b-b873-fe0f9fdca1e1 tempest-ServerActionsTestJSON-644666636 tempest-ServerActionsTestJSON-644666636-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417148967" status: 202 len: 0 microversion: 2.1 time: 0.022914 Apr 17 19:30:11 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:30:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1417148967 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.objects.instance [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lazy-loading 'fault' on Instance uuid 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f {{(pid=61729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:43 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-dda75845-12fa-4ee3-a88e-7f160c4db570 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f" status: 200 len: 1650 microversion: 2.87 time: 0.178789 Apr 17 19:30:43 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 111/334] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:30:42 2023] GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f => generated 1650 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=16 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Doing local delete in cell 557b61a6-7c46-4750-bdf8-90d5a8f88bb1(cell1) {{(pid=61727) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61727]: WARNING nova.compute.api [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] instance's host None is down, deleting from database Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] deallocate_for_instance() {{(pid=61727) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Instance cache missing network info. {{(pid=61727) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Updating instance_info_cache with network_info: [] {{(pid=61727) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 17 19:30:43 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61727) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 17 19:30:43 user devstack@n-api.service[61727]: WARNING nova.compute.api [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 17 19:30:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2e876026-671f-4c12-8a19-7682a025d8fa tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f" status: 204 len: 0 microversion: 2.87 time: 0.558222 Apr 17 19:30:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 112/335] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:30:43 2023] DELETE /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] HTTP exception thrown: Instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f could not be found. Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Request method failure captured: Apr 17 19:30:43 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f HTTP/1.1 Apr 17 19:30:43 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:30:43 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:30:43 user devstack@n-api.service[61728]: Connection: close Apr 17 19:30:43 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:30:43 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:30:43 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:30:43 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:30:43 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZyYhefhexC3Wln-iK8NmMF8eZM_NocbDF2S7QpSjfZaKcDug-dWkqGyVdDQ3n9_UxLR7uQHxl3B-Z4iCQVxKv8Z-5yJCzQ9w7CxQ_xoFvbT_CiNrM1BLTwU84AJ_lO54qVOobgQWlZuVaCuaAz5SL_hTeZrU56c0XtLTgANZltbWsk Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Project-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Tenant-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:30:43 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:30:43 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:30:43 user devstack@n-api.service[61728]: X-User-Id: 564b229ded9c40dfa3a6afc15663c832 Apr 17 19:30:43 user devstack@n-api.service[61728]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:30:43 user devstack@n-api.service[61728]: method: > Apr 17 19:30:43 user devstack@n-api.service[61728]: exception: Instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f could not be found. Apr 17 19:30:43 user devstack@n-api.service[61728]: action_args: {'id': '8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f'} Apr 17 19:30:43 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f could not be found. Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f could not be found. Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f could not be found. Apr 17 19:30:43 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:30:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Returning 404 to user: Instance 8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:30:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bf814855-c49e-4cdc-a60d-5e362f5ebd48 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f" status: 404 len: 111 microversion: 2.87 time: 0.035050 Apr 17 19:30:43 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 113/336] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:30:43 2023] GET /compute/v2.1/servers/8d3539b6-ccfb-4e80-a07e-2eca3bb53d1f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:43 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:30:44 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6020aa4f-deb2-4d64-8945-bfe1dc7f3724 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e" status: 204 len: 0 microversion: 2.87 time: 0.110015 Apr 17 19:30:44 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 112/337] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:30:43 2023] DELETE /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:44 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:30:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-270a55c5-2123-444e-bbc6-08e79789f3fc tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e" status: 200 len: 1696 microversion: 2.87 time: 0.265635 Apr 17 19:30:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 113/338] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:30:44 2023] GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e => generated 1696 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:30:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-06603335-4b4f-4a76-957b-e652babab930 req-c85530a6-1109-4b01-b961-4bb0a2f408ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-unplugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-06603335-4b4f-4a76-957b-e652babab930 req-c85530a6-1109-4b01-b961-4bb0a2f408ea service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-06603335-4b4f-4a76-957b-e652babab930 req-c85530a6-1109-4b01-b961-4bb0a2f408ea service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-06603335-4b4f-4a76-957b-e652babab930 req-c85530a6-1109-4b01-b961-4bb0a2f408ea service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-06603335-4b4f-4a76-957b-e652babab930 req-c85530a6-1109-4b01-b961-4bb0a2f408ea service nova] Creating event network-vif-unplugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-06603335-4b4f-4a76-957b-e652babab930 req-c85530a6-1109-4b01-b961-4bb0a2f408ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031073 Apr 17 19:30:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 114/339] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:30:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:30:45 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-129b020d-47d2-4e0c-a6ed-78889f2b40f9 req-e170a80e-721a-46ca-9070-53f57d9af6b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-deleted", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:45 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-129b020d-47d2-4e0c-a6ed-78889f2b40f9 req-e170a80e-721a-46ca-9070-53f57d9af6b6 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:45 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-129b020d-47d2-4e0c-a6ed-78889f2b40f9 req-e170a80e-721a-46ca-9070-53f57d9af6b6 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:45 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-129b020d-47d2-4e0c-a6ed-78889f2b40f9 req-e170a80e-721a-46ca-9070-53f57d9af6b6 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:45 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-129b020d-47d2-4e0c-a6ed-78889f2b40f9 req-e170a80e-721a-46ca-9070-53f57d9af6b6 service nova] Creating event network-vif-deleted:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:45 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-129b020d-47d2-4e0c-a6ed-78889f2b40f9 req-e170a80e-721a-46ca-9070-53f57d9af6b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029106 Apr 17 19:30:45 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 113/340] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:30:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:30:46 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-plugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}, {"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-plugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}, {"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-plugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}, {"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-unplugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}, {"server_uuid": "aa257428-cbc8-412e-8260-1ef8a1e2584e", "name": "network-vif-plugged", "status": "completed", "tag": "620f3eea-fd75-432d-b001-5eb4be0ff6dc"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:30:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:30:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:30:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:30:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Creating event network-vif-plugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Creating event network-vif-plugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Creating event network-vif-plugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Creating event network-vif-unplugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] Creating event network-vif-plugged:620f3eea-fd75-432d-b001-5eb4be0ff6dc for instance aa257428-cbc8-412e-8260-1ef8a1e2584e on user Apr 17 19:30:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-a391292c-b4f6-4f98-881a-697e0b6476b7 req-6896f8f2-a4f2-4d5c-ab7e-f13c46bd7ea5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.032005 Apr 17 19:30:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 114/341] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:30:46 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:09 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:09 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-938d77c5-edb8-475e-be98-7f2c4105ee0e tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.175503 Apr 17 19:31:09 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 115/342] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:31:09 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112/os-interface => generated 283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:09 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:09 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:10 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:10 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2f5c9481-f404-46dc-bb04-ae3b30bd2165 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112/ips" status: 200 len: 109 microversion: 2.1 time: 0.037089 Apr 17 19:31:10 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 115/343] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:31:10 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:10 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-2c795430-ddcc-4e3a-81a8-8ee7ece64211 req-708f42a3-8d4e-4ef2-bfee-818c6ad8871a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-2c795430-ddcc-4e3a-81a8-8ee7ece64211 req-708f42a3-8d4e-4ef2-bfee-818c6ad8871a service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-2c795430-ddcc-4e3a-81a8-8ee7ece64211 req-708f42a3-8d4e-4ef2-bfee-818c6ad8871a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:10 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-2c795430-ddcc-4e3a-81a8-8ee7ece64211 req-708f42a3-8d4e-4ef2-bfee-818c6ad8871a service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-2c795430-ddcc-4e3a-81a8-8ee7ece64211 req-708f42a3-8d4e-4ef2-bfee-818c6ad8871a service nova] Creating event network-changed:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:31:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-2c795430-ddcc-4e3a-81a8-8ee7ece64211 req-708f42a3-8d4e-4ef2-bfee-818c6ad8871a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169232 Apr 17 19:31:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 114/344] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:11 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:31:11 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-9b783801-d43a-4316-a16c-e7bdf3c60db0 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 204 len: 0 microversion: 2.1 time: 0.117219 Apr 17 19:31:11 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 116/345] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:31:11 2023] DELETE /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:11 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:31:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-599071c2-5c80-4571-99f2-e638f68c9de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 200 len: 1670 microversion: 2.1 time: 0.193907 Apr 17 19:31:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 116/346] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:31:11 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:31:11 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-6865d2a6-7223-4e81-bf88-ec53562dad4d req-dc0ef97b-cfa1-41c5-a5a1-fa0202307805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "name": "network-vif-unplugged", "status": "completed", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-6865d2a6-7223-4e81-bf88-ec53562dad4d req-dc0ef97b-cfa1-41c5-a5a1-fa0202307805 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-6865d2a6-7223-4e81-bf88-ec53562dad4d req-dc0ef97b-cfa1-41c5-a5a1-fa0202307805 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-6865d2a6-7223-4e81-bf88-ec53562dad4d req-dc0ef97b-cfa1-41c5-a5a1-fa0202307805 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:11 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-6865d2a6-7223-4e81-bf88-ec53562dad4d req-dc0ef97b-cfa1-41c5-a5a1-fa0202307805 service nova] Creating event network-vif-unplugged:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:31:11 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-6865d2a6-7223-4e81-bf88-ec53562dad4d req-dc0ef97b-cfa1-41c5-a5a1-fa0202307805 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030199 Apr 17 19:31:11 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:13 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-5aae1769-8eb0-405e-9b20-920e8793e371 req-5951f9f9-43ca-4b94-b094-4050ecb061cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "name": "network-vif-deleted", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5aae1769-8eb0-405e-9b20-920e8793e371 req-5951f9f9-43ca-4b94-b094-4050ecb061cc service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5aae1769-8eb0-405e-9b20-920e8793e371 req-5951f9f9-43ca-4b94-b094-4050ecb061cc service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:13 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-5aae1769-8eb0-405e-9b20-920e8793e371 req-5951f9f9-43ca-4b94-b094-4050ecb061cc service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:13 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-5aae1769-8eb0-405e-9b20-920e8793e371 req-5951f9f9-43ca-4b94-b094-4050ecb061cc service nova] Creating event network-vif-deleted:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:31:13 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-5aae1769-8eb0-405e-9b20-920e8793e371 req-5951f9f9-43ca-4b94-b094-4050ecb061cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030158 Apr 17 19:31:13 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:13 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-62545fb9-b932-4ea2-873f-d2f4c3af7343 req-6e00cc96-e779-4566-8f04-dba3691e9888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c12e346-61c9-4ad6-b3f4-4349bc070112", "name": "network-vif-plugged", "status": "completed", "tag": "58da74d1-c40a-42be-b3d3-ffc1b29d270a"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-62545fb9-b932-4ea2-873f-d2f4c3af7343 req-6e00cc96-e779-4566-8f04-dba3691e9888 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-62545fb9-b932-4ea2-873f-d2f4c3af7343 req-6e00cc96-e779-4566-8f04-dba3691e9888 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:13 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-62545fb9-b932-4ea2-873f-d2f4c3af7343 req-6e00cc96-e779-4566-8f04-dba3691e9888 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-62545fb9-b932-4ea2-873f-d2f4c3af7343 req-6e00cc96-e779-4566-8f04-dba3691e9888 service nova] Creating event network-vif-plugged:58da74d1-c40a-42be-b3d3-ffc1b29d270a for instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 on user Apr 17 19:31:13 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-62545fb9-b932-4ea2-873f-d2f4c3af7343 req-6e00cc96-e779-4566-8f04-dba3691e9888 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Apr 17 19:31:13 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 117/349] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: aa257428-cbc8-412e-8260-1ef8a1e2584e] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] HTTP exception thrown: Instance aa257428-cbc8-412e-8260-1ef8a1e2584e could not be found. Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Request method failure captured: Apr 17 19:31:34 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e HTTP/1.1 Apr 17 19:31:34 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:31:34 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:31:34 user devstack@n-api.service[61729]: Connection: close Apr 17 19:31:34 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:31:34 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:31:34 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:31:34 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:31:34 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZyYhefhexC3Wln-iK8NmMF8eZM_NocbDF2S7QpSjfZaKcDug-dWkqGyVdDQ3n9_UxLR7uQHxl3B-Z4iCQVxKv8Z-5yJCzQ9w7CxQ_xoFvbT_CiNrM1BLTwU84AJ_lO54qVOobgQWlZuVaCuaAz5SL_hTeZrU56c0XtLTgANZltbWsk Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Project-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Tenant-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:31:34 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:31:34 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:31:34 user devstack@n-api.service[61729]: X-User-Id: 564b229ded9c40dfa3a6afc15663c832 Apr 17 19:31:34 user devstack@n-api.service[61729]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:31:34 user devstack@n-api.service[61729]: method: > Apr 17 19:31:34 user devstack@n-api.service[61729]: exception: Instance aa257428-cbc8-412e-8260-1ef8a1e2584e could not be found. Apr 17 19:31:34 user devstack@n-api.service[61729]: action_args: {'id': 'aa257428-cbc8-412e-8260-1ef8a1e2584e'} Apr 17 19:31:34 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa257428-cbc8-412e-8260-1ef8a1e2584e could not be found. Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa257428-cbc8-412e-8260-1ef8a1e2584e could not be found. Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa257428-cbc8-412e-8260-1ef8a1e2584e could not be found. Apr 17 19:31:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Returning 404 to user: Instance aa257428-cbc8-412e-8260-1ef8a1e2584e could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:31:34 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-f4796384-b875-46f9-b12d-30a1404c3842 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e" status: 404 len: 111 microversion: 2.87 time: 0.035245 Apr 17 19:31:34 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 116/350] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:31:34 2023] GET /compute/v2.1/servers/aa257428-cbc8-412e-8260-1ef8a1e2584e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:31:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-602718c0-de3b-4101-bc41-f01f8ecf9ab5 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd" status: 204 len: 0 microversion: 2.87 time: 0.121680 Apr 17 19:31:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 118/351] 10.0.0.210 () {64 vars in 1357 bytes} [Mon Apr 17 19:31:34 2023] DELETE /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=12 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-8efd26b9-a7af-44b1-be7f-180b12eabc76 req-22bfd7da-c3f2-425f-8bf9-41a81b98ae88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b23140-b111-4d4f-87f1-f890efb1bacd", "name": "network-vif-unplugged", "status": "completed", "tag": "b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8efd26b9-a7af-44b1-be7f-180b12eabc76 req-22bfd7da-c3f2-425f-8bf9-41a81b98ae88 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8efd26b9-a7af-44b1-be7f-180b12eabc76 req-22bfd7da-c3f2-425f-8bf9-41a81b98ae88 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-8efd26b9-a7af-44b1-be7f-180b12eabc76 req-22bfd7da-c3f2-425f-8bf9-41a81b98ae88 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:34 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-8efd26b9-a7af-44b1-be7f-180b12eabc76 req-22bfd7da-c3f2-425f-8bf9-41a81b98ae88 service nova] Creating event network-vif-unplugged:b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af for instance c2b23140-b111-4d4f-87f1-f890efb1bacd on user Apr 17 19:31:34 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-8efd26b9-a7af-44b1-be7f-180b12eabc76 req-22bfd7da-c3f2-425f-8bf9-41a81b98ae88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027010 Apr 17 19:31:34 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 117/352] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:31:34 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '564b229ded9c40dfa3a6afc15663c832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99dac87706794aafbb9794b3b4f863c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:31:34 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-8d6996a7-47a7-4775-9ad5-acd06c424afb tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd" status: 200 len: 1696 microversion: 2.87 time: 0.247647 Apr 17 19:31:34 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 118/353] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:31:34 2023] GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd => generated 1696 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 17 19:31:36 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-8bf00e60-5210-4a42-9ea9-28e01fd13144 req-e5624fbb-07c9-4480-9301-0cb3d229c224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b23140-b111-4d4f-87f1-f890efb1bacd", "name": "network-vif-deleted", "tag": "b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-8bf00e60-5210-4a42-9ea9-28e01fd13144 req-e5624fbb-07c9-4480-9301-0cb3d229c224 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-8bf00e60-5210-4a42-9ea9-28e01fd13144 req-e5624fbb-07c9-4480-9301-0cb3d229c224 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-8bf00e60-5210-4a42-9ea9-28e01fd13144 req-e5624fbb-07c9-4480-9301-0cb3d229c224 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-8bf00e60-5210-4a42-9ea9-28e01fd13144 req-e5624fbb-07c9-4480-9301-0cb3d229c224 service nova] Creating event network-vif-deleted:b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af for instance c2b23140-b111-4d4f-87f1-f890efb1bacd on user Apr 17 19:31:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-8bf00e60-5210-4a42-9ea9-28e01fd13144 req-e5624fbb-07c9-4480-9301-0cb3d229c224 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089181 Apr 17 19:31:36 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 119/354] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:31:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-3b280ee8-fdec-47f1-81cb-b7c569bffae0 req-a279529f-6515-4f01-af78-0348df69ed19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b23140-b111-4d4f-87f1-f890efb1bacd", "name": "network-vif-plugged", "status": "completed", "tag": "b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:31:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-3b280ee8-fdec-47f1-81cb-b7c569bffae0 req-a279529f-6515-4f01-af78-0348df69ed19 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:31:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-3b280ee8-fdec-47f1-81cb-b7c569bffae0 req-a279529f-6515-4f01-af78-0348df69ed19 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:31:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-3b280ee8-fdec-47f1-81cb-b7c569bffae0 req-a279529f-6515-4f01-af78-0348df69ed19 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:31:37 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-3b280ee8-fdec-47f1-81cb-b7c569bffae0 req-a279529f-6515-4f01-af78-0348df69ed19 service nova] Creating event network-vif-plugged:b2287dcb-9bd7-45c4-9fe1-39b9f9ff94af for instance c2b23140-b111-4d4f-87f1-f890efb1bacd on user Apr 17 19:31:37 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-3b280ee8-fdec-47f1-81cb-b7c569bffae0 req-a279529f-6515-4f01-af78-0348df69ed19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031505 Apr 17 19:31:37 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 118/355] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:31:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:32:01 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 HTTP/1.1 Apr 17 19:32:01 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:32:01 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:32:01 user devstack@n-api.service[61727]: Connection: close Apr 17 19:32:01 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:32:01 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:32:01 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:32:01 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:32:01 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:32:01 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:32:01 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:32:01 user devstack@n-api.service[61727]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:32:01 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:32:01 user devstack@n-api.service[61727]: method: > Apr 17 19:32:01 user devstack@n-api.service[61727]: exception: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:32:01 user devstack@n-api.service[61727]: action_args: {'id': '6c12e346-61c9-4ad6-b3f4-4349bc070112'} Apr 17 19:32:01 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:32:01 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:32:01 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:32:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-3f0f30e8-b980-4ab2-b7b6-1dfff94e44b6 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 404 len: 111 microversion: 2.1 time: 0.033369 Apr 17 19:32:01 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 119/356] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:32:01 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:32:01 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:01 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:01 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-c10cf09b-b714-433e-a5f4-9faa586df615 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '.version_select at 0x7f84d1eec940>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:01 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-c10cf09b-b714-433e-a5f4-9faa586df615 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230504393" status: 202 len: 0 microversion: 2.1 time: 0.030836 Apr 17 19:32:01 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1295 bytes} [Mon Apr 17 19:32:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230504393 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:32:02 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:02 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:02 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-331030f9-391b-4536-8aeb-9b213963614d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Action: 'create', calling method: .version_select at 0x7f84d1c24af0>, body: {"keypair": {"name": "tempest-keypair-1647992201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwyK9HSVf4syLZ9WPYBr2S6+XLZzy+T+OKlnR8XihejXF/gSXT6rUihOGfYP0XvlmoLB+QFJymTQETQ+myNZvrpEKgoTcp2935XRaw46aPv1CPw83BghloHyzWgfRi4vQ=="}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:02 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-331030f9-391b-4536-8aeb-9b213963614d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:32:02 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-331030f9-391b-4536-8aeb-9b213963614d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for user 4418cca50c8240deb6176062f7857ba8 and project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'key_pairs'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:32:02 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-331030f9-391b-4536-8aeb-9b213963614d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058457 Apr 17 19:32:02 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 119/358] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:32:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1818210675", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2d7a0107-3c9c-45b6-b90e-d27573251b32"}], "security_groups": [{"name": "tempest-securitygroup--714029710"}], "key_name": "tempest-keypair-1647992201", "user_data": "}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] validate_networks() for [('2d7a0107-3c9c-45b6-b90e-d27573251b32', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for user 4418cca50c8240deb6176062f7857ba8 and project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:32:04 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:32:04 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-21028dbc-965b-4c15-b519-b5c120c1d455 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.675333 Apr 17 19:32:04 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 120/359] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:32:04 2023] POST /compute/v2.1/servers => generated 399 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:32:04 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-df485908-85f1-49ab-847d-37c91bf4be3a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:04 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-df485908-85f1-49ab-847d-37c91bf4be3a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:32:04 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-df485908-85f1-49ab-847d-37c91bf4be3a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:32:04 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-df485908-85f1-49ab-847d-37c91bf4be3a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 200 len: 1236 microversion: 2.1 time: 0.085102 Apr 17 19:32:04 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 121/360] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:32:04 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:32:07 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-5e1b48ae-de8d-49f1-b711-70151a04d977 req-ccdea4b1-8a90-4b58-b31d-610b1ddd9279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:07 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-5e1b48ae-de8d-49f1-b711-70151a04d977 req-ccdea4b1-8a90-4b58-b31d-610b1ddd9279 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:07 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-5e1b48ae-de8d-49f1-b711-70151a04d977 req-ccdea4b1-8a90-4b58-b31d-610b1ddd9279 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:07 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-5e1b48ae-de8d-49f1-b711-70151a04d977 req-ccdea4b1-8a90-4b58-b31d-610b1ddd9279 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:07 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-5e1b48ae-de8d-49f1-b711-70151a04d977 req-ccdea4b1-8a90-4b58-b31d-610b1ddd9279 service nova] Creating event network-changed:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:32:07 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-5e1b48ae-de8d-49f1-b711-70151a04d977 req-ccdea4b1-8a90-4b58-b31d-610b1ddd9279 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030334 Apr 17 19:32:07 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 120/361] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:09 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-3fece706-8663-4a0f-b5cd-02bbc4a4ed45 req-c1a96d5a-3b2b-49f3-9410-90b1f0adbbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-plugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-3fece706-8663-4a0f-b5cd-02bbc4a4ed45 req-c1a96d5a-3b2b-49f3-9410-90b1f0adbbd3 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-3fece706-8663-4a0f-b5cd-02bbc4a4ed45 req-c1a96d5a-3b2b-49f3-9410-90b1f0adbbd3 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:09 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-3fece706-8663-4a0f-b5cd-02bbc4a4ed45 req-c1a96d5a-3b2b-49f3-9410-90b1f0adbbd3 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-3fece706-8663-4a0f-b5cd-02bbc4a4ed45 req-c1a96d5a-3b2b-49f3-9410-90b1f0adbbd3 service nova] Creating event network-vif-plugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:32:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-3fece706-8663-4a0f-b5cd-02bbc4a4ed45 req-c1a96d5a-3b2b-49f3-9410-90b1f0adbbd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037947 Apr 17 19:32:09 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 121/362] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:11 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-d2586b35-156b-4056-a4a2-9af1e159556c req-ba0d77eb-b021-4993-85be-cd36b772f570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-plugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-d2586b35-156b-4056-a4a2-9af1e159556c req-ba0d77eb-b021-4993-85be-cd36b772f570 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-d2586b35-156b-4056-a4a2-9af1e159556c req-ba0d77eb-b021-4993-85be-cd36b772f570 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:11 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-d2586b35-156b-4056-a4a2-9af1e159556c req-ba0d77eb-b021-4993-85be-cd36b772f570 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:11 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-d2586b35-156b-4056-a4a2-9af1e159556c req-ba0d77eb-b021-4993-85be-cd36b772f570 service nova] Creating event network-vif-plugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:32:11 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-d2586b35-156b-4056-a4a2-9af1e159556c req-ba0d77eb-b021-4993-85be-cd36b772f570 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029005 Apr 17 19:32:11 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 122/363] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] [instance: c2b23140-b111-4d4f-87f1-f890efb1bacd] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:25 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] HTTP exception thrown: Instance c2b23140-b111-4d4f-87f1-f890efb1bacd could not be found. Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Request method failure captured: Apr 17 19:32:25 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd HTTP/1.1 Apr 17 19:32:25 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:32:25 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:32:25 user devstack@n-api.service[61729]: Connection: close Apr 17 19:32:25 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:32:25 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:32:25 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:32:25 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:32:25 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZyYhefhexC3Wln-iK8NmMF8eZM_NocbDF2S7QpSjfZaKcDug-dWkqGyVdDQ3n9_UxLR7uQHxl3B-Z4iCQVxKv8Z-5yJCzQ9w7CxQ_xoFvbT_CiNrM1BLTwU84AJ_lO54qVOobgQWlZuVaCuaAz5SL_hTeZrU56c0XtLTgANZltbWsk Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Openstack-Nova-Api-Version: 2.87 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Project-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/99dac87706794aafbb9794b3b4f863c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Tenant-Id: 99dac87706794aafbb9794b3b4f863c4 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:32:25 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:32:25 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:32:25 user devstack@n-api.service[61729]: X-User-Id: 564b229ded9c40dfa3a6afc15663c832 Apr 17 19:32:25 user devstack@n-api.service[61729]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member Apr 17 19:32:25 user devstack@n-api.service[61729]: method: > Apr 17 19:32:25 user devstack@n-api.service[61729]: exception: Instance c2b23140-b111-4d4f-87f1-f890efb1bacd could not be found. Apr 17 19:32:25 user devstack@n-api.service[61729]: action_args: {'id': 'c2b23140-b111-4d4f-87f1-f890efb1bacd'} Apr 17 19:32:25 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b23140-b111-4d4f-87f1-f890efb1bacd could not be found. Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b23140-b111-4d4f-87f1-f890efb1bacd could not be found. Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b23140-b111-4d4f-87f1-f890efb1bacd could not be found. Apr 17 19:32:25 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:32:25 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] Returning 404 to user: Instance c2b23140-b111-4d4f-87f1-f890efb1bacd could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:32:25 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-08193f57-2feb-4611-a069-8ee6b0410517 tempest-ServerBootFromVolumeStableRescueTest-1906361111 tempest-ServerBootFromVolumeStableRescueTest-1906361111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd" status: 404 len: 111 microversion: 2.87 time: 0.033810 Apr 17 19:32:25 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 121/364] 10.0.0.210 () {64 vars in 1354 bytes} [Mon Apr 17 19:32:25 2023] GET /compute/v2.1/servers/c2b23140-b111-4d4f-87f1-f890efb1bacd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 17 19:32:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:34 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:34 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-833108402", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] validate_networks() for [('d36355c5-c4cf-411d-bb01-d462a6c54da1', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Getting quotas for project e5a720a783674c96b0c4bc4ebaafe1b1. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Getting quotas for user d634485279404fc6858c90e215f7f52f and project e5a720a783674c96b0c4bc4ebaafe1b1. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:32:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:32:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-c0ba93ca-3627-4044-934f-1a4ec0f4e23b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.666988 Apr 17 19:32:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 122/365] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:32:34 2023] POST /compute/v2.1/servers => generated 381 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:32:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:35 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-40614982-ddf1-4e7c-843a-996235ebdc4f tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:35 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-40614982-ddf1-4e7c-843a-996235ebdc4f tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:32:35 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-40614982-ddf1-4e7c-843a-996235ebdc4f tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:32:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-40614982-ddf1-4e7c-843a-996235ebdc4f tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3" status: 200 len: 1215 microversion: 2.1 time: 0.072365 Apr 17 19:32:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:32:35 2023] GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:32:35 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1268237769", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:35 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:35 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:35 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] validate_networks() for [('d36355c5-c4cf-411d-bb01-d462a6c54da1', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Getting quotas for project e5a720a783674c96b0c4bc4ebaafe1b1. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Getting quotas for user d634485279404fc6858c90e215f7f52f and project e5a720a783674c96b0c4bc4ebaafe1b1. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:32:36 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:32:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-92c137fd-1969-4939-82a2-14d1d103bdf2 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.616593 Apr 17 19:32:36 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 122/367] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:32:35 2023] POST /compute/v2.1/servers => generated 381 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:32:36 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-7b9f420b-4559-459a-9112-e81802f09ec8 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:36 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-7b9f420b-4559-459a-9112-e81802f09ec8 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:32:36 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-7b9f420b-4559-459a-9112-e81802f09ec8 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:32:36 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-7b9f420b-4559-459a-9112-e81802f09ec8 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 200 len: 1216 microversion: 2.1 time: 0.058790 Apr 17 19:32:36 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 123/368] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:32:36 2023] GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 1216 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:32:37 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-b55b1e60-4371-44f2-946b-2777e9d0592d req-8677273a-d966-4ded-b746-b578226828c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c21d45-e9eb-48a8-af00-d1ea5efd13a3", "tag": "c5ceae2f-38d4-43eb-9ca6-733f269f7f01"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b55b1e60-4371-44f2-946b-2777e9d0592d req-8677273a-d966-4ded-b746-b578226828c6 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b55b1e60-4371-44f2-946b-2777e9d0592d req-8677273a-d966-4ded-b746-b578226828c6 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:37 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b55b1e60-4371-44f2-946b-2777e9d0592d req-8677273a-d966-4ded-b746-b578226828c6 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-b55b1e60-4371-44f2-946b-2777e9d0592d req-8677273a-d966-4ded-b746-b578226828c6 service nova] Creating event network-changed:c5ceae2f-38d4-43eb-9ca6-733f269f7f01 for instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 on user Apr 17 19:32:37 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-b55b1e60-4371-44f2-946b-2777e9d0592d req-8677273a-d966-4ded-b746-b578226828c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045977 Apr 17 19:32:37 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 124/369] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:38 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-2137ae40-06e3-4ef1-a10c-86cee966a911 req-70346174-563e-46b2-bc69-0d78458524af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:38 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-2137ae40-06e3-4ef1-a10c-86cee966a911 req-70346174-563e-46b2-bc69-0d78458524af service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:38 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-2137ae40-06e3-4ef1-a10c-86cee966a911 req-70346174-563e-46b2-bc69-0d78458524af service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:38 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-2137ae40-06e3-4ef1-a10c-86cee966a911 req-70346174-563e-46b2-bc69-0d78458524af service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:38 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-2137ae40-06e3-4ef1-a10c-86cee966a911 req-70346174-563e-46b2-bc69-0d78458524af service nova] Creating event network-changed:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:32:38 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-2137ae40-06e3-4ef1-a10c-86cee966a911 req-70346174-563e-46b2-bc69-0d78458524af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 Apr 17 19:32:38 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 123/370] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:39 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-8dffc5b2-89dd-416d-ac41-529faf14e375 req-a83f756e-76ec-47d8-9cae-1a4588ba0c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c21d45-e9eb-48a8-af00-d1ea5efd13a3", "name": "network-vif-plugged", "status": "completed", "tag": "c5ceae2f-38d4-43eb-9ca6-733f269f7f01"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8dffc5b2-89dd-416d-ac41-529faf14e375 req-a83f756e-76ec-47d8-9cae-1a4588ba0c58 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8dffc5b2-89dd-416d-ac41-529faf14e375 req-a83f756e-76ec-47d8-9cae-1a4588ba0c58 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:40 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8dffc5b2-89dd-416d-ac41-529faf14e375 req-a83f756e-76ec-47d8-9cae-1a4588ba0c58 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-8dffc5b2-89dd-416d-ac41-529faf14e375 req-a83f756e-76ec-47d8-9cae-1a4588ba0c58 service nova] Creating event network-vif-plugged:c5ceae2f-38d4-43eb-9ca6-733f269f7f01 for instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 on user Apr 17 19:32:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-8dffc5b2-89dd-416d-ac41-529faf14e375 req-a83f756e-76ec-47d8-9cae-1a4588ba0c58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050835 Apr 17 19:32:40 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 124/371] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:41 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-16efd9a5-fa85-4669-9e3b-a36190b73e0d req-ea8613da-c6d2-4ce3-bf8e-bdbba3db3c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-plugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-16efd9a5-fa85-4669-9e3b-a36190b73e0d req-ea8613da-c6d2-4ce3-bf8e-bdbba3db3c00 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-16efd9a5-fa85-4669-9e3b-a36190b73e0d req-ea8613da-c6d2-4ce3-bf8e-bdbba3db3c00 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-16efd9a5-fa85-4669-9e3b-a36190b73e0d req-ea8613da-c6d2-4ce3-bf8e-bdbba3db3c00 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:41 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-16efd9a5-fa85-4669-9e3b-a36190b73e0d req-ea8613da-c6d2-4ce3-bf8e-bdbba3db3c00 service nova] Creating event network-vif-plugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:32:41 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-16efd9a5-fa85-4669-9e3b-a36190b73e0d req-ea8613da-c6d2-4ce3-bf8e-bdbba3db3c00 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Apr 17 19:32:41 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 125/372] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:42 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-21d96649-9166-4e62-a0fc-dcb4e3158326 req-04c3d155-d6b4-498a-a2b5-c91615e13121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c21d45-e9eb-48a8-af00-d1ea5efd13a3", "name": "network-vif-plugged", "status": "completed", "tag": "c5ceae2f-38d4-43eb-9ca6-733f269f7f01"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-21d96649-9166-4e62-a0fc-dcb4e3158326 req-04c3d155-d6b4-498a-a2b5-c91615e13121 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-21d96649-9166-4e62-a0fc-dcb4e3158326 req-04c3d155-d6b4-498a-a2b5-c91615e13121 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:42 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-21d96649-9166-4e62-a0fc-dcb4e3158326 req-04c3d155-d6b4-498a-a2b5-c91615e13121 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:42 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-21d96649-9166-4e62-a0fc-dcb4e3158326 req-04c3d155-d6b4-498a-a2b5-c91615e13121 service nova] Creating event network-vif-plugged:c5ceae2f-38d4-43eb-9ca6-733f269f7f01 for instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 on user Apr 17 19:32:42 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-21d96649-9166-4e62-a0fc-dcb4e3158326 req-04c3d155-d6b4-498a-a2b5-c91615e13121 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027180 Apr 17 19:32:42 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 124/373] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:43 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-6d83cc95-09d8-4ede-ae5e-dd657a60f062 req-c27f2fa0-11e1-4cfd-8527-3cb35021d548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-plugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:32:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-6d83cc95-09d8-4ede-ae5e-dd657a60f062 req-c27f2fa0-11e1-4cfd-8527-3cb35021d548 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-6d83cc95-09d8-4ede-ae5e-dd657a60f062 req-c27f2fa0-11e1-4cfd-8527-3cb35021d548 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:43 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-6d83cc95-09d8-4ede-ae5e-dd657a60f062 req-c27f2fa0-11e1-4cfd-8527-3cb35021d548 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-6d83cc95-09d8-4ede-ae5e-dd657a60f062 req-c27f2fa0-11e1-4cfd-8527-3cb35021d548 service nova] Creating event network-vif-plugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:32:43 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-6d83cc95-09d8-4ede-ae5e-dd657a60f062 req-c27f2fa0-11e1-4cfd-8527-3cb35021d548 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028014 Apr 17 19:32:43 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 125/374] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:32:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:32:54 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:32:55 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:32:55 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bde12907-c3c8-4d55-a035-e475990adb21 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 200 len: 1546 microversion: 2.1 time: 0.259756 Apr 17 19:32:55 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 126/375] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:32:54 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 1546 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:26 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:33:26 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-023f7883-fd2f-4678-a19a-a9f885a80a27 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 200 len: 1504 microversion: 2.1 time: 0.232444 Apr 17 19:33:26 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 125/376] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:33:26 2023] GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:55 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:55 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-e686577c-d407-44bf-9085-496311780cca tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.179937 Apr 17 19:33:55 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 126/377] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:33:55 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0/os-interface => generated 283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:33:56 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:56 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-80f0d57b-576a-423f-859a-d5f104f85e48 req-d528e941-9548-4657-902e-499a484385df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:33:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-80f0d57b-576a-423f-859a-d5f104f85e48 req-d528e941-9548-4657-902e-499a484385df service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-80f0d57b-576a-423f-859a-d5f104f85e48 req-d528e941-9548-4657-902e-499a484385df service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-80f0d57b-576a-423f-859a-d5f104f85e48 req-d528e941-9548-4657-902e-499a484385df service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-80f0d57b-576a-423f-859a-d5f104f85e48 req-d528e941-9548-4657-902e-499a484385df service nova] Creating event network-changed:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:33:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-80f0d57b-576a-423f-859a-d5f104f85e48 req-d528e941-9548-4657-902e-499a484385df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046449 Apr 17 19:33:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 127/378] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:33:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:56 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-b068d67e-6359-4a1a-8d7d-2684877b7497 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0/ips" status: 200 len: 109 microversion: 2.1 time: 0.039423 Apr 17 19:33:56 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 126/379] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:33:56 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:58 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:33:58 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-52f34316-02b2-4463-8103-18c0e6daa613 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 204 len: 0 microversion: 2.1 time: 0.145285 Apr 17 19:33:58 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 127/380] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:33:58 2023] DELETE /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:58 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:33:58 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-38820f66-9e09-408a-be2e-a83adfc8d442 req-836f0670-f96a-4cfa-b44f-2c005ed797be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-unplugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:33:58 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-fca39eee-255e-42ac-950d-f4ffa87b922a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 200 len: 1670 microversion: 2.1 time: 0.214442 Apr 17 19:33:58 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 128/381] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:33:58 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 1670 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:33:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-38820f66-9e09-408a-be2e-a83adfc8d442 req-836f0670-f96a-4cfa-b44f-2c005ed797be service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:33:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-38820f66-9e09-408a-be2e-a83adfc8d442 req-836f0670-f96a-4cfa-b44f-2c005ed797be service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:33:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-38820f66-9e09-408a-be2e-a83adfc8d442 req-836f0670-f96a-4cfa-b44f-2c005ed797be service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:33:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-38820f66-9e09-408a-be2e-a83adfc8d442 req-836f0670-f96a-4cfa-b44f-2c005ed797be service nova] Creating event network-vif-unplugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:33:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-38820f66-9e09-408a-be2e-a83adfc8d442 req-836f0670-f96a-4cfa-b44f-2c005ed797be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041154 Apr 17 19:33:58 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-edb22cde-1a64-4131-ac67-87f6bf89a66a req-6aef829c-5468-4019-8b88-85f9dcf720b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-deleted", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-edb22cde-1a64-4131-ac67-87f6bf89a66a req-6aef829c-5468-4019-8b88-85f9dcf720b9 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-edb22cde-1a64-4131-ac67-87f6bf89a66a req-6aef829c-5468-4019-8b88-85f9dcf720b9 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:00 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-edb22cde-1a64-4131-ac67-87f6bf89a66a req-6aef829c-5468-4019-8b88-85f9dcf720b9 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-edb22cde-1a64-4131-ac67-87f6bf89a66a req-6aef829c-5468-4019-8b88-85f9dcf720b9 service nova] Creating event network-vif-deleted:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:34:00 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-edb22cde-1a64-4131-ac67-87f6bf89a66a req-6aef829c-5468-4019-8b88-85f9dcf720b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035553 Apr 17 19:34:00 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 128/383] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:00 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-plugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}, {"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-plugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}, {"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-plugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}, {"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-unplugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}, {"server_uuid": "b4803d87-e6f9-4c4c-a98c-987080c455c0", "name": "network-vif-plugged", "status": "completed", "tag": "32900155-0dfe-493e-b636-f837ca774a92"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Creating event network-vif-plugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:34:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Creating event network-vif-plugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:34:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Creating event network-vif-plugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:34:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Creating event network-vif-unplugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:34:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] Creating event network-vif-plugged:32900155-0dfe-493e-b636-f837ca774a92 for instance b4803d87-e6f9-4c4c-a98c-987080c455c0 on user Apr 17 19:34:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-2e1dfffa-44c6-4ba0-9137-f4b3a96c34a2 req-b27f21b1-d987-4e30-843e-6cd9a59063d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030984 Apr 17 19:34:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 129/384] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:00 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:26 user devstack@n-api.service[61729]: DEBUG nova.objects.instance [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lazy-loading 'flavor' on Instance uuid 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 {{(pid=61729) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 17 19:34:26 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-d15e0508-cc31-4125-9551-fe8244c87a9e tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51/action" status: 200 len: 32 microversion: 2.1 time: 0.143333 Apr 17 19:34:26 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 128/385] 10.0.0.210 () {64 vars in 1355 bytes} [Mon Apr 17 19:34:26 2023] POST /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51/action => generated 32 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:26 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:27 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:34:27 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-02ba3824-8678-4107-b124-1183cafb3b43 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 200 len: 1510 microversion: 2.1 time: 0.384974 Apr 17 19:34:27 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 129/386] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:34:26 2023] GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:34:27 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:27 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=10 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:27 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-7c4b5573-8318-44a6-8fd7-7728330691f2 req-4268120f-1471-45a0-b2a0-637b8d0fd4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-unplugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7c4b5573-8318-44a6-8fd7-7728330691f2 req-4268120f-1471-45a0-b2a0-637b8d0fd4a6 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7c4b5573-8318-44a6-8fd7-7728330691f2 req-4268120f-1471-45a0-b2a0-637b8d0fd4a6 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:27 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-7c4b5573-8318-44a6-8fd7-7728330691f2 req-4268120f-1471-45a0-b2a0-637b8d0fd4a6 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-7c4b5573-8318-44a6-8fd7-7728330691f2 req-4268120f-1471-45a0-b2a0-637b8d0fd4a6 service nova] Creating event network-vif-unplugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:34:27 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-7c4b5573-8318-44a6-8fd7-7728330691f2 req-4268120f-1471-45a0-b2a0-637b8d0fd4a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043757 Apr 17 19:34:27 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 130/387] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:29 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-26e5443d-5f70-4ccd-ac04-e801cc849d67 req-0299d963-8f71-4363-8792-3bba901c73fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-plugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-26e5443d-5f70-4ccd-ac04-e801cc849d67 req-0299d963-8f71-4363-8792-3bba901c73fe service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-26e5443d-5f70-4ccd-ac04-e801cc849d67 req-0299d963-8f71-4363-8792-3bba901c73fe service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:29 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-26e5443d-5f70-4ccd-ac04-e801cc849d67 req-0299d963-8f71-4363-8792-3bba901c73fe service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:29 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-26e5443d-5f70-4ccd-ac04-e801cc849d67 req-0299d963-8f71-4363-8792-3bba901c73fe service nova] Creating event network-vif-plugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:34:29 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-26e5443d-5f70-4ccd-ac04-e801cc849d67 req-0299d963-8f71-4363-8792-3bba901c73fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032736 Apr 17 19:34:29 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:31 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-plugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}, {"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-plugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:31 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] Creating event network-vif-plugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:34:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] Creating event network-vif-plugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:34:31 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-4833e7ae-6a56-4c99-8fb0-066ab783da7c req-0e0fd2b0-9af7-4f80-b67e-eb5e3faab666 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029674 Apr 17 19:34:31 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 130/389] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:34:48 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 HTTP/1.1 Apr 17 19:34:48 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:34:48 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:34:48 user devstack@n-api.service[61728]: Connection: close Apr 17 19:34:48 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:34:48 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:34:48 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:34:48 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:34:48 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:34:48 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:34:48 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:34:48 user devstack@n-api.service[61728]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:34:48 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:34:48 user devstack@n-api.service[61728]: method: > Apr 17 19:34:48 user devstack@n-api.service[61728]: exception: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:34:48 user devstack@n-api.service[61728]: action_args: {'id': 'b4803d87-e6f9-4c4c-a98c-987080c455c0'} Apr 17 19:34:48 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:34:48 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:34:48 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:34:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-7c4fd258-5635-48d3-b068-a08cd39aa3cd tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 404 len: 111 microversion: 2.1 time: 0.185156 Apr 17 19:34:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:34:48 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:34:48 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=4 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:48 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:48 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-35739d6b-e807-444b-a5e9-73ddc1c3f958 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '.version_select at 0x7f84d1c275b0>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:34:48 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-35739d6b-e807-444b-a5e9-73ddc1c3f958 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647992201" status: 202 len: 0 microversion: 2.1 time: 0.025712 Apr 17 19:34:48 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 130/391] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:34:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647992201 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:34:49 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:49 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:34:49 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-cbb4c1c9-a2e7-427e-bc0b-018e0695a3af tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Action: 'create', calling method: .version_select at 0x7f84d1c7f2e0>, body: {"keypair": {"name": "tempest-keypair-1162267789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1RC/UXyW7hSv+DDkBy4AJyOIRRVqOtlzwOzGLfdDcYSPmPqrjui9Ggb71kzyybU/nuq2byjXh4vTVh8uhQoZgaVMHkrfK51BsYOU35eu50HPnQHRqVccrIuXEr8S0Dcw=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:49 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-cbb4c1c9-a2e7-427e-bc0b-018e0695a3af tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:34:49 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-cbb4c1c9-a2e7-427e-bc0b-018e0695a3af tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for user 4418cca50c8240deb6176062f7857ba8 and project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:34:49 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-cbb4c1c9-a2e7-427e-bc0b-018e0695a3af tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050278 Apr 17 19:34:49 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 131/392] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:34:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:50 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-865441818", "imageRef": "003f99eb-9d8f-4734-989c-fb7e29875453", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2d7a0107-3c9c-45b6-b90e-d27573251b32"}], "security_groups": [{"name": "tempest-securitygroup--1554402207"}], "key_name": "tempest-keypair-1162267789", "user_data": "}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.network.neutron [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] validate_networks() for [('2d7a0107-3c9c-45b6-b90e-d27573251b32', None, None, None, None, None)] {{(pid=61728) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Flavor limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Image limits 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Flavor pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Image pref 0:0:0 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.virt.hardware [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61728) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Getting quotas for user 4418cca50c8240deb6176062f7857ba8 and project b9a1fb9e25e44d02a1d400b64fa15994. Resources: {'ram', 'instances', 'cores'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Going to run 1 instances... {{(pid=61728) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:34:51 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='003f99eb-9d8f-4734-989c-fb7e29875453',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61728) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:34:51 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-bd09d3d6-3727-43be-841b-60225904da9a tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.818867 Apr 17 19:34:51 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 132/393] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:34:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:34:51 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-7f4d0719-02bc-4262-817c-c4072689a007 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:34:51 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-7f4d0719-02bc-4262-817c-c4072689a007 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:34:51 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-7f4d0719-02bc-4262-817c-c4072689a007 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:34:51 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-7f4d0719-02bc-4262-817c-c4072689a007 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 200 len: 1235 microversion: 2.1 time: 0.070132 Apr 17 19:34:51 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 131/394] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:34:51 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 1235 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:34:54 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-a4274521-11f9-496a-8e45-cc2b7abab8fc req-02c928b7-964c-4ee4-ac17-2f2aabf66812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a4274521-11f9-496a-8e45-cc2b7abab8fc req-02c928b7-964c-4ee4-ac17-2f2aabf66812 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a4274521-11f9-496a-8e45-cc2b7abab8fc req-02c928b7-964c-4ee4-ac17-2f2aabf66812 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:54 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a4274521-11f9-496a-8e45-cc2b7abab8fc req-02c928b7-964c-4ee4-ac17-2f2aabf66812 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a4274521-11f9-496a-8e45-cc2b7abab8fc req-02c928b7-964c-4ee4-ac17-2f2aabf66812 service nova] Creating event network-changed:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:34:54 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-a4274521-11f9-496a-8e45-cc2b7abab8fc req-02c928b7-964c-4ee4-ac17-2f2aabf66812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029922 Apr 17 19:34:54 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:56 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-2634c81e-dbaf-461e-8895-7af76be82d35 req-3bc3dcac-3c27-4632-9e40-fbd906741b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "name": "network-vif-plugged", "status": "completed", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2634c81e-dbaf-461e-8895-7af76be82d35 req-3bc3dcac-3c27-4632-9e40-fbd906741b0b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2634c81e-dbaf-461e-8895-7af76be82d35 req-3bc3dcac-3c27-4632-9e40-fbd906741b0b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:56 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-2634c81e-dbaf-461e-8895-7af76be82d35 req-3bc3dcac-3c27-4632-9e40-fbd906741b0b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-2634c81e-dbaf-461e-8895-7af76be82d35 req-3bc3dcac-3c27-4632-9e40-fbd906741b0b service nova] Creating event network-vif-plugged:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:34:56 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-2634c81e-dbaf-461e-8895-7af76be82d35 req-3bc3dcac-3c27-4632-9e40-fbd906741b0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096187 Apr 17 19:34:56 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 133/396] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:34:58 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-bc9819be-4f46-49b3-9a94-cd7817fbf887 req-c4bd8b33-5cbc-48ba-84c9-60bad0732cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "name": "network-vif-plugged", "status": "completed", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:34:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-bc9819be-4f46-49b3-9a94-cd7817fbf887 req-c4bd8b33-5cbc-48ba-84c9-60bad0732cfe service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:34:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-bc9819be-4f46-49b3-9a94-cd7817fbf887 req-c4bd8b33-5cbc-48ba-84c9-60bad0732cfe service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:34:58 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-bc9819be-4f46-49b3-9a94-cd7817fbf887 req-c4bd8b33-5cbc-48ba-84c9-60bad0732cfe service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:34:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-bc9819be-4f46-49b3-9a94-cd7817fbf887 req-c4bd8b33-5cbc-48ba-84c9-60bad0732cfe service nova] Creating event network-vif-plugged:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:34:58 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-bc9819be-4f46-49b3-9a94-cd7817fbf887 req-c4bd8b33-5cbc-48ba-84c9-60bad0732cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029482 Apr 17 19:34:58 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 132/397] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:34:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:35:17 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:35:17 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-6ac8940d-caca-4dcc-9c16-a87002f345a3 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 200 len: 1490 microversion: 2.1 time: 0.300068 Apr 17 19:35:17 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:35:17 2023] GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 1490 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:35:41 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:35:42 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:35:42 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-23b4df3f-091b-4d2c-b14c-bd5288fa2de9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 200 len: 1546 microversion: 2.1 time: 0.233493 Apr 17 19:35:42 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:35:41 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 1546 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:17 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:36:17 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-5113b9e2-fcc1-4611-9c92-6547251b7a41 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3" status: 200 len: 1502 microversion: 2.1 time: 0.305853 Apr 17 19:36:17 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 133/400] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:36:17 2023] GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3 => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:42 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:42 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-b00b6f85-a81d-43cd-9e47-6cc3a9b0805d tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.167705 Apr 17 19:36:42 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 134/401] 10.0.0.210 () {62 vars in 1352 bytes} [Mon Apr 17 19:36:42 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755/os-interface => generated 283 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:36:42 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:42 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:43 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:43 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-085f9d65-e177-4c86-bba7-03c42b6fa438 req-ff956261-d8a9-4c63-8d0c-5bc4447f8eab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:36:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-085f9d65-e177-4c86-bba7-03c42b6fa438 req-ff956261-d8a9-4c63-8d0c-5bc4447f8eab service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-085f9d65-e177-4c86-bba7-03c42b6fa438 req-ff956261-d8a9-4c63-8d0c-5bc4447f8eab service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:43 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-085f9d65-e177-4c86-bba7-03c42b6fa438 req-ff956261-d8a9-4c63-8d0c-5bc4447f8eab service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:43 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-68f0364a-19e6-467a-947b-f5ace1fd95a9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755/ips" status: 200 len: 109 microversion: 2.1 time: 0.039689 Apr 17 19:36:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-085f9d65-e177-4c86-bba7-03c42b6fa438 req-ff956261-d8a9-4c63-8d0c-5bc4447f8eab service nova] Creating event network-changed:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:36:43 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 134/402] 10.0.0.210 () {62 vars in 1325 bytes} [Mon Apr 17 19:36:43 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:36:43 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-085f9d65-e177-4c86-bba7-03c42b6fa438 req-ff956261-d8a9-4c63-8d0c-5bc4447f8eab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094785 Apr 17 19:36:43 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 135/403] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:36:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:44 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:36:44 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f9f297f5-7803-41f7-9799-6af675d00c2c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 204 len: 0 microversion: 2.1 time: 0.119110 Apr 17 19:36:44 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:36:44 2023] DELETE /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:44 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4418cca50c8240deb6176062f7857ba8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a1fb9e25e44d02a1d400b64fa15994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:36:44 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-561dbc7f-2a59-439f-a695-5393f7380e4b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 200 len: 1671 microversion: 2.1 time: 0.239023 Apr 17 19:36:44 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 135/405] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:36:44 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 1671 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:36:44 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-512a37ec-783b-4aa2-bc60-45bbb49bdc11 req-70533fa4-574a-429e-b118-03be83efaf5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "name": "network-vif-unplugged", "status": "completed", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:36:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-512a37ec-783b-4aa2-bc60-45bbb49bdc11 req-70533fa4-574a-429e-b118-03be83efaf5d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-512a37ec-783b-4aa2-bc60-45bbb49bdc11 req-70533fa4-574a-429e-b118-03be83efaf5d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:44 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-512a37ec-783b-4aa2-bc60-45bbb49bdc11 req-70533fa4-574a-429e-b118-03be83efaf5d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-512a37ec-783b-4aa2-bc60-45bbb49bdc11 req-70533fa4-574a-429e-b118-03be83efaf5d service nova] Creating event network-vif-unplugged:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:36:44 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-512a37ec-783b-4aa2-bc60-45bbb49bdc11 req-70533fa4-574a-429e-b118-03be83efaf5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030698 Apr 17 19:36:44 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 136/406] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:36:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:36:45 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-0b486b24-62cb-4b43-a89e-89123bc3e300 req-cdf68065-ea2a-415e-8d8c-e9d568e18c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "name": "network-vif-deleted", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:36:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0b486b24-62cb-4b43-a89e-89123bc3e300 req-cdf68065-ea2a-415e-8d8c-e9d568e18c7e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0b486b24-62cb-4b43-a89e-89123bc3e300 req-cdf68065-ea2a-415e-8d8c-e9d568e18c7e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:46 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-0b486b24-62cb-4b43-a89e-89123bc3e300 req-cdf68065-ea2a-415e-8d8c-e9d568e18c7e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-0b486b24-62cb-4b43-a89e-89123bc3e300 req-cdf68065-ea2a-415e-8d8c-e9d568e18c7e service nova] Creating event network-vif-deleted:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:36:46 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-0b486b24-62cb-4b43-a89e-89123bc3e300 req-cdf68065-ea2a-415e-8d8c-e9d568e18c7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028167 Apr 17 19:36:46 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:36:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:36:46 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-d3305687-d3b5-4140-98b7-41858d6ea692 req-fe76b74d-a03b-47a6-92d5-a9a6f1321408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4ae1ee9-105a-4890-8c30-ce5c1c3e3755", "name": "network-vif-plugged", "status": "completed", "tag": "86eafa3e-2c62-4347-87ff-749dfb17c4c5"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:36:46 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-d3305687-d3b5-4140-98b7-41858d6ea692 req-fe76b74d-a03b-47a6-92d5-a9a6f1321408 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:36:46 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-d3305687-d3b5-4140-98b7-41858d6ea692 req-fe76b74d-a03b-47a6-92d5-a9a6f1321408 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:36:46 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-d3305687-d3b5-4140-98b7-41858d6ea692 req-fe76b74d-a03b-47a6-92d5-a9a6f1321408 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:36:46 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-d3305687-d3b5-4140-98b7-41858d6ea692 req-fe76b74d-a03b-47a6-92d5-a9a6f1321408 service nova] Creating event network-vif-plugged:86eafa3e-2c62-4347-87ff-749dfb17c4c5 for instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 on user Apr 17 19:36:46 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-d3305687-d3b5-4140-98b7-41858d6ea692 req-fe76b74d-a03b-47a6-92d5-a9a6f1321408 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027501 Apr 17 19:36:46 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 136/408] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:36:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:21 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Going to try to terminate instance {{(pid=61728) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:37:21 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-3894cef1-a0b9-4bee-bb34-2ba71631b7fa tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 204 len: 0 microversion: 2.1 time: 0.111144 Apr 17 19:37:21 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 137/409] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:37:21 2023] DELETE /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:21 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:37:21 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-80aaf74e-ccfd-424c-91a6-5b7f6321f00c tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 200 len: 1496 microversion: 2.1 time: 0.313779 Apr 17 19:37:21 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:37:21 2023] GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 1496 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:37:21 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-e84df0a4-6f4e-4f12-bbbe-d5d66be3fb02 req-e5d520ea-2264-4d26-9fc7-b01dad272dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-unplugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:37:21 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:21 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=12 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e84df0a4-6f4e-4f12-bbbe-d5d66be3fb02 req-e5d520ea-2264-4d26-9fc7-b01dad272dbc service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e84df0a4-6f4e-4f12-bbbe-d5d66be3fb02 req-e5d520ea-2264-4d26-9fc7-b01dad272dbc service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:21 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-e84df0a4-6f4e-4f12-bbbe-d5d66be3fb02 req-e5d520ea-2264-4d26-9fc7-b01dad272dbc service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:21 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-e84df0a4-6f4e-4f12-bbbe-d5d66be3fb02 req-e5d520ea-2264-4d26-9fc7-b01dad272dbc service nova] Creating event network-vif-unplugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:37:21 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-e84df0a4-6f4e-4f12-bbbe-d5d66be3fb02 req-e5d520ea-2264-4d26-9fc7-b01dad272dbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033684 Apr 17 19:37:21 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 137/411] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:37:22 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-b50e06c4-a384-4366-aa93-b74a073f59e6 req-76a74b80-d3e9-479c-b3ff-c31846db8fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-deleted", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:37:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b50e06c4-a384-4366-aa93-b74a073f59e6 req-76a74b80-d3e9-479c-b3ff-c31846db8fe1 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b50e06c4-a384-4366-aa93-b74a073f59e6 req-76a74b80-d3e9-479c-b3ff-c31846db8fe1 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:22 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-b50e06c4-a384-4366-aa93-b74a073f59e6 req-76a74b80-d3e9-479c-b3ff-c31846db8fe1 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-b50e06c4-a384-4366-aa93-b74a073f59e6 req-76a74b80-d3e9-479c-b3ff-c31846db8fe1 service nova] Creating event network-vif-deleted:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:37:22 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-b50e06c4-a384-4366-aa93-b74a073f59e6 req-76a74b80-d3e9-479c-b3ff-c31846db8fe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085640 Apr 17 19:37:22 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:37:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:37:23 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-bedf5c9c-d424-4d94-bdad-93784b3f38db req-6dea160c-aa6a-4751-a596-b17824ec38ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51", "name": "network-vif-plugged", "status": "completed", "tag": "1368a272-80ac-42e7-98fa-a87f4ee6571c"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:37:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-bedf5c9c-d424-4d94-bdad-93784b3f38db req-6dea160c-aa6a-4751-a596-b17824ec38ae service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-bedf5c9c-d424-4d94-bdad-93784b3f38db req-6dea160c-aa6a-4751-a596-b17824ec38ae service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:23 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-bedf5c9c-d424-4d94-bdad-93784b3f38db req-6dea160c-aa6a-4751-a596-b17824ec38ae service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-bedf5c9c-d424-4d94-bdad-93784b3f38db req-6dea160c-aa6a-4751-a596-b17824ec38ae service nova] Creating event network-vif-plugged:1368a272-80ac-42e7-98fa-a87f4ee6571c for instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 on user Apr 17 19:37:23 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-bedf5c9c-d424-4d94-bdad-93784b3f38db req-6dea160c-aa6a-4751-a596-b17824ec38ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033116 Apr 17 19:37:23 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 138/413] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:37:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:34 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:34 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 HTTP/1.1 Apr 17 19:37:34 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:37:34 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:37:34 user devstack@n-api.service[61729]: Connection: close Apr 17 19:37:34 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:37:34 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:37:34 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:37:34 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:37:34 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:34 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:37:34 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:37:34 user devstack@n-api.service[61729]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:34 user devstack@n-api.service[61729]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:34 user devstack@n-api.service[61729]: method: > Apr 17 19:37:34 user devstack@n-api.service[61729]: exception: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:34 user devstack@n-api.service[61729]: action_args: {'id': 'e4ae1ee9-105a-4890-8c30-ce5c1c3e3755'} Apr 17 19:37:34 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:34 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:34 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:34 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-00bcb331-aabb-4818-bd38-31ed35cd930c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 404 len: 111 microversion: 2.1 time: 0.037994 Apr 17 19:37:34 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 138/414] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:37:34 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:37:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:34 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:34 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-df2a4e47-d323-4952-9f56-4d8bbfb35a8c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '.version_select at 0x7f84d1eecc10>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:34 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-df2a4e47-d323-4952-9f56-4d8bbfb35a8c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162267789" status: 202 len: 0 microversion: 2.1 time: 0.027833 Apr 17 19:37:34 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 139/415] 10.0.0.210 () {62 vars in 1298 bytes} [Mon Apr 17 19:37:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1162267789 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:35 user devstack@n-api.service[61727]: request: DELETE /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 HTTP/1.1 Apr 17 19:37:35 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:37:35 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:37:35 user devstack@n-api.service[61727]: Connection: close Apr 17 19:37:35 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:37:35 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:37:35 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:37:35 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:37:35 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61727]: method: > Apr 17 19:37:35 user devstack@n-api.service[61727]: exception: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: action_args: {'id': 'e4ae1ee9-105a-4890-8c30-ce5c1c3e3755'} Apr 17 19:37:35 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-851fe314-4084-47e3-8aae-a394d9978128 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 404 len: 111 microversion: 2.1 time: 0.032301 Apr 17 19:37:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 139/416] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:37:35 2023] DELETE /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: e4ae1ee9-105a-4890-8c30-ce5c1c3e3755] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:35 user devstack@n-api.service[61729]: request: GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 HTTP/1.1 Apr 17 19:37:35 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:37:35 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:37:35 user devstack@n-api.service[61729]: Connection: close Apr 17 19:37:35 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:37:35 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:37:35 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:37:35 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:37:35 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61729]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:35 user devstack@n-api.service[61729]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61729]: method: > Apr 17 19:37:35 user devstack@n-api.service[61729]: exception: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61729]: action_args: {'id': 'e4ae1ee9-105a-4890-8c30-ce5c1c3e3755'} Apr 17 19:37:35 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:35 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-3aea9f90-d456-4b88-a10b-4b7aa80260f9 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755" status: 404 len: 111 microversion: 2.1 time: 0.026504 Apr 17 19:37:35 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 139/417] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:37:35 2023] GET /compute/v2.1/servers/e4ae1ee9-105a-4890-8c30-ce5c1c3e3755 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:35 user devstack@n-api.service[61728]: request: DELETE /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 HTTP/1.1 Apr 17 19:37:35 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:37:35 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:37:35 user devstack@n-api.service[61728]: Connection: close Apr 17 19:37:35 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:37:35 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:37:35 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:37:35 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:37:35 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61728]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:35 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61728]: method: > Apr 17 19:37:35 user devstack@n-api.service[61728]: exception: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61728]: action_args: {'id': 'b4803d87-e6f9-4c4c-a98c-987080c455c0'} Apr 17 19:37:35 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:35 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ba251a39-d950-43e1-a66b-24a68ecac5de tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 404 len: 111 microversion: 2.1 time: 0.026933 Apr 17 19:37:35 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 140/418] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:37:35 2023] DELETE /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: b4803d87-e6f9-4c4c-a98c-987080c455c0] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:35 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 HTTP/1.1 Apr 17 19:37:35 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:37:35 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:37:35 user devstack@n-api.service[61727]: Connection: close Apr 17 19:37:35 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:37:35 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:37:35 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:37:35 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:37:35 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:35 user devstack@n-api.service[61727]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:35 user devstack@n-api.service[61727]: method: > Apr 17 19:37:35 user devstack@n-api.service[61727]: exception: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: action_args: {'id': 'b4803d87-e6f9-4c4c-a98c-987080c455c0'} Apr 17 19:37:35 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. Apr 17 19:37:35 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:37:35 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance b4803d87-e6f9-4c4c-a98c-987080c455c0 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:35 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-a77f5d7c-5639-444c-86ee-663a3f837ac4 tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0" status: 404 len: 111 microversion: 2.1 time: 0.029623 Apr 17 19:37:35 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 140/419] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:37:35 2023] GET /compute/v2.1/servers/b4803d87-e6f9-4c4c-a98c-987080c455c0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.wsgi [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:36 user devstack@n-api.service[61729]: request: DELETE /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 HTTP/1.1 Apr 17 19:37:36 user devstack@n-api.service[61729]: Accept: application/json Apr 17 19:37:36 user devstack@n-api.service[61729]: Accept-Encoding: identity Apr 17 19:37:36 user devstack@n-api.service[61729]: Connection: close Apr 17 19:37:36 user devstack@n-api.service[61729]: Content-Length: 0 Apr 17 19:37:36 user devstack@n-api.service[61729]: Content-Type: application/json Apr 17 19:37:36 user devstack@n-api.service[61729]: Host: 10.0.0.210 Apr 17 19:37:36 user devstack@n-api.service[61729]: Openstack-System-Scope: None Apr 17 19:37:36 user devstack@n-api.service[61729]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Domain-Id: None Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Domain-Name: None Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Identity-Status: Confirmed Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Is-Admin-Project: True Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Project-Domain-Id: default Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Project-Domain-Name: Default Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Role: reader,member Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Roles: reader,member Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:36 user devstack@n-api.service[61729]: X-User-Domain-Id: default Apr 17 19:37:36 user devstack@n-api.service[61729]: X-User-Domain-Name: Default Apr 17 19:37:36 user devstack@n-api.service[61729]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:36 user devstack@n-api.service[61729]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:36 user devstack@n-api.service[61729]: method: > Apr 17 19:37:36 user devstack@n-api.service[61729]: exception: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61729]: action_args: {'id': '6c12e346-61c9-4ad6-b3f4-4349bc070112'} Apr 17 19:37:36 user devstack@n-api.service[61729]: {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61729]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. {{(pid=61729) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:36 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-3415d4ae-00a9-4c5f-88ca-7f5bc790162b tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 404 len: 111 microversion: 2.1 time: 0.025860 Apr 17 19:37:36 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 140/420] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:37:36 2023] DELETE /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] [instance: 6c12e346-61c9-4ad6-b3f4-4349bc070112] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:37:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] HTTP exception thrown: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Request method failure captured: Apr 17 19:37:36 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 HTTP/1.1 Apr 17 19:37:36 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:37:36 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:37:36 user devstack@n-api.service[61728]: Connection: close Apr 17 19:37:36 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:37:36 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:37:36 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:37:36 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:37:36 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPZ4MwV4tEULJrbGcfvHSALGP5umQU8457vwNJ0dQb2arXXIgI8zqS3K6N-vBEatkx7ZENkjGILvQ4nb8ePhfX37xV4ffcZg6mv_EVkKyHb5D7KXjj_CeSzG1eEyT9TB_jaILgxl9_f-mL9pXgyblN_cCB12e53nTajKpEzk41kPEbSI Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Project-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Project-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b9a1fb9e25e44d02a1d400b64fa15994"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Tenant: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Tenant-Id: b9a1fb9e25e44d02a1d400b64fa15994 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-76087227 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-User: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:36 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:37:36 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:37:36 user devstack@n-api.service[61728]: X-User-Id: 4418cca50c8240deb6176062f7857ba8 Apr 17 19:37:36 user devstack@n-api.service[61728]: X-User-Name: tempest-AttachVolumeNegativeTest-76087227-project-member Apr 17 19:37:36 user devstack@n-api.service[61728]: method: > Apr 17 19:37:36 user devstack@n-api.service[61728]: exception: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61728]: action_args: {'id': '6c12e346-61c9-4ad6-b3f4-4349bc070112'} Apr 17 19:37:36 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. Apr 17 19:37:36 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:37:36 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] Returning 404 to user: Instance 6c12e346-61c9-4ad6-b3f4-4349bc070112 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:37:36 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6944262f-cf22-4fd5-bba4-4d5fb209635c tempest-AttachVolumeNegativeTest-76087227 tempest-AttachVolumeNegativeTest-76087227-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112" status: 404 len: 111 microversion: 2.1 time: 0.028281 Apr 17 19:37:36 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 141/421] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:37:36 2023] GET /compute/v2.1/servers/6c12e346-61c9-4ad6-b3f4-4349bc070112 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:38:09 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-f5d92170-9022-43f3-ab0e-b61523923e10 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Action: 'create', calling method: .version_select at 0x7f84d1c7e440>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-312513621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf8sSsns689Kh+OM7O/67L5RLa9A3+94Ug4fSRAa/qBWb92OpnI9rZkxaGZMcd2QwkcRjD+PptOtB7ZtnFrAGQpHfHKn0VLRl9PKnR0crvnysXOlf700Tna3IMTLO9K7A=="}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:09 user devstack@n-api.service[61727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 19:38:09 user devstack@n-api.service[61727]: Mon Apr 17 19:38:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Apr 17 19:38:09 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:38:09 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:38:09 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-f5d92170-9022-43f3-ab0e-b61523923e10 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for project 183324fc7e8040058b3a5c9130c7415e. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:38:09 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-f5d92170-9022-43f3-ab0e-b61523923e10 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for user f6dc578937fa4cbd9665652bbd0153fa and project 183324fc7e8040058b3a5c9130c7415e. Resources: {'key_pairs'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:38:09 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-f5d92170-9022-43f3-ab0e-b61523923e10 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.058895 Apr 17 19:38:09 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 141/422] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:38:09 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-324004632", "imageRef": "243a9006-3633-4cea-aa14-2d05cf681cae", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-312513621", "networks": [{"uuid": "749c9efa-f82b-4393-9bef-5426eac09e93"}]}} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.network.neutron [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] validate_networks() for [('749c9efa-f82b-4393-9bef-5426eac09e93', None, None, None, None, None)] {{(pid=61729) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Flavor limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Image limits 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Flavor pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Image pref 0:0:0 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.virt.hardware [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61729) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for project 183324fc7e8040058b3a5c9130c7415e. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.quota [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for user f6dc578937fa4cbd9665652bbd0153fa and project 183324fc7e8040058b3a5c9130c7415e. Resources: {'ram', 'instances', 'cores'} {{(pid=61729) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Going to run 1 instances... {{(pid=61729) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:38:09 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='243a9006-3633-4cea-aa14-2d05cf681cae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61729) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:38:10 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-3c18eaae-e741-45bb-b6da-afd87d8eac3e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.777378 Apr 17 19:38:10 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 141/423] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:38:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:38:10 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e57f8ee1-e310-42c9-b025-1d281d7e3c5a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:38:10 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-e57f8ee1-e310-42c9-b025-1d281d7e3c5a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:38:10 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:38:10 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:38:10 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-e57f8ee1-e310-42c9-b025-1d281d7e3c5a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:38:10 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e57f8ee1-e310-42c9-b025-1d281d7e3c5a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 200 len: 1251 microversion: 2.1 time: 0.076577 Apr 17 19:38:10 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:38:10 2023] GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 1251 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] HTTP exception thrown: Instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 could not be found. Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Request method failure captured: Apr 17 19:38:11 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 HTTP/1.1 Apr 17 19:38:11 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:38:11 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:38:11 user devstack@n-api.service[61727]: Connection: close Apr 17 19:38:11 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:38:11 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:38:11 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:38:11 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:38:11 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZ7S2yF7dRWRjELV2M54LwYToePw3p6-BYuu061b3Eg50DBJTLpkLGMImuczev0ZcP5QiJo2Yi49KkQOkAacaqk8XOZLv_EUbC19N-gqB88G-SnQsdy0-AIGNrD1q1b_lBLeEV8WnT5iGea1UnqijxiF3yf45CSj4-MUlFyjoK5MXdI Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Project-Id: e5a720a783674c96b0c4bc4ebaafe1b1 Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520768636 Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e5a720a783674c96b0c4bc4ebaafe1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5a720a783674c96b0c4bc4ebaafe1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5a720a783674c96b0c4bc4ebaafe1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520768636 Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Tenant-Id: e5a720a783674c96b0c4bc4ebaafe1b1 Apr 17 19:38:11 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520768636 Apr 17 19:38:11 user devstack@n-api.service[61727]: X-User: tempest-ServerRescueNegativeTestJSON-1520768636-project-member Apr 17 19:38:11 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:38:11 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:38:11 user devstack@n-api.service[61727]: X-User-Id: d634485279404fc6858c90e215f7f52f Apr 17 19:38:11 user devstack@n-api.service[61727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520768636-project-member Apr 17 19:38:11 user devstack@n-api.service[61727]: method: > Apr 17 19:38:11 user devstack@n-api.service[61727]: exception: Instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 could not be found. Apr 17 19:38:11 user devstack@n-api.service[61727]: action_args: {'id': '6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51'} Apr 17 19:38:11 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 could not be found. Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 could not be found. Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 could not be found. Apr 17 19:38:11 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:38:11 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Returning 404 to user: Instance 6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:38:11 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-5199151b-d0fc-4136-8684-3fd4ea13d61b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51" status: 404 len: 111 microversion: 2.1 time: 0.194942 Apr 17 19:38:11 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:38:11 2023] GET /compute/v2.1/servers/6d379bb9-c9f6-4ed2-a2b0-bacf1ab39e51 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:11 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:38:12 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6db4bb45-2f96-4f94-9915-d0d77561c945 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3" status: 204 len: 0 microversion: 2.1 time: 0.124352 Apr 17 19:38:12 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 142/426] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:38:11 2023] DELETE /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:12 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd634485279404fc6858c90e215f7f52f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5a720a783674c96b0c4bc4ebaafe1b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:38:12 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-0869df69-2ec6-4d65-8ce5-42b9c5258db4 tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3" status: 200 len: 1508 microversion: 2.1 time: 0.250261 Apr 17 19:38:12 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 143/427] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:38:12 2023] GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3 => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 17 19:38:12 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-8ba32379-2e8a-417c-be9a-4d22ce5bb21a req-786aa975-ed8c-4447-a39e-3ad3d330e6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c21d45-e9eb-48a8-af00-d1ea5efd13a3", "name": "network-vif-unplugged", "status": "completed", "tag": "c5ceae2f-38d4-43eb-9ca6-733f269f7f01"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:12 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8ba32379-2e8a-417c-be9a-4d22ce5bb21a req-786aa975-ed8c-4447-a39e-3ad3d330e6f8 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:12 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8ba32379-2e8a-417c-be9a-4d22ce5bb21a req-786aa975-ed8c-4447-a39e-3ad3d330e6f8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:12 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-8ba32379-2e8a-417c-be9a-4d22ce5bb21a req-786aa975-ed8c-4447-a39e-3ad3d330e6f8 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:12 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-8ba32379-2e8a-417c-be9a-4d22ce5bb21a req-786aa975-ed8c-4447-a39e-3ad3d330e6f8 service nova] Creating event network-vif-unplugged:c5ceae2f-38d4-43eb-9ca6-733f269f7f01 for instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 on user Apr 17 19:38:12 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-8ba32379-2e8a-417c-be9a-4d22ce5bb21a req-786aa975-ed8c-4447-a39e-3ad3d330e6f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030072 Apr 17 19:38:12 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 143/428] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:38:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:38:13 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-ba9796d0-100d-45a3-b639-d7aaf34b2d5a req-31bcf09d-f52e-48c7-81f7-ae3cc1ebfa2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c21d45-e9eb-48a8-af00-d1ea5efd13a3", "name": "network-vif-deleted", "tag": "c5ceae2f-38d4-43eb-9ca6-733f269f7f01"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-ba9796d0-100d-45a3-b639-d7aaf34b2d5a req-31bcf09d-f52e-48c7-81f7-ae3cc1ebfa2e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-ba9796d0-100d-45a3-b639-d7aaf34b2d5a req-31bcf09d-f52e-48c7-81f7-ae3cc1ebfa2e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:13 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-ba9796d0-100d-45a3-b639-d7aaf34b2d5a req-31bcf09d-f52e-48c7-81f7-ae3cc1ebfa2e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:13 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-ba9796d0-100d-45a3-b639-d7aaf34b2d5a req-31bcf09d-f52e-48c7-81f7-ae3cc1ebfa2e service nova] Creating event network-vif-deleted:c5ceae2f-38d4-43eb-9ca6-733f269f7f01 for instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 on user Apr 17 19:38:13 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-ba9796d0-100d-45a3-b639-d7aaf34b2d5a req-31bcf09d-f52e-48c7-81f7-ae3cc1ebfa2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032702 Apr 17 19:38:13 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 143/429] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:38:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:38:14 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f30f9b3c-3c23-4753-a464-da2662890f7c", "tag": "c7d43ab2-3180-42c1-83d4-a5e4904efd86"}, {"server_uuid": "10c21d45-e9eb-48a8-af00-d1ea5efd13a3", "name": "network-vif-plugged", "status": "completed", "tag": "c5ceae2f-38d4-43eb-9ca6-733f269f7f01"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:14 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] Creating event network-changed:c7d43ab2-3180-42c1-83d4-a5e4904efd86 for instance f30f9b3c-3c23-4753-a464-da2662890f7c on user Apr 17 19:38:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] Creating event network-vif-plugged:c5ceae2f-38d4-43eb-9ca6-733f269f7f01 for instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 on user Apr 17 19:38:14 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-da48d3da-cdca-45dc-a6ed-4ca630f6dc1c req-ef917a92-396b-42c5-b624-a62f86aac278 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.034276 Apr 17 19:38:14 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 144/430] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:38:14 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:38:14 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-ee654570-ae4a-41d4-ab43-c49396f1a2ea req-06dfe94d-4118-4244-b1d5-9781d7eff462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30f9b3c-3c23-4753-a464-da2662890f7c", "name": "network-vif-plugged", "status": "completed", "tag": "c7d43ab2-3180-42c1-83d4-a5e4904efd86"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ee654570-ae4a-41d4-ab43-c49396f1a2ea req-06dfe94d-4118-4244-b1d5-9781d7eff462 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ee654570-ae4a-41d4-ab43-c49396f1a2ea req-06dfe94d-4118-4244-b1d5-9781d7eff462 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:14 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-ee654570-ae4a-41d4-ab43-c49396f1a2ea req-06dfe94d-4118-4244-b1d5-9781d7eff462 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-ee654570-ae4a-41d4-ab43-c49396f1a2ea req-06dfe94d-4118-4244-b1d5-9781d7eff462 service nova] Creating event network-vif-plugged:c7d43ab2-3180-42c1-83d4-a5e4904efd86 for instance f30f9b3c-3c23-4753-a464-da2662890f7c on user Apr 17 19:38:14 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-ee654570-ae4a-41d4-ab43-c49396f1a2ea req-06dfe94d-4118-4244-b1d5-9781d7eff462 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037818 Apr 17 19:38:14 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 144/431] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:38:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:38:16 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-c29482f2-6782-4b4e-bf97-d93dccdee167 req-361c963a-2838-47d4-b543-657a3a280c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30f9b3c-3c23-4753-a464-da2662890f7c", "name": "network-vif-plugged", "status": "completed", "tag": "c7d43ab2-3180-42c1-83d4-a5e4904efd86"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:38:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c29482f2-6782-4b4e-bf97-d93dccdee167 req-361c963a-2838-47d4-b543-657a3a280c0c service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:38:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c29482f2-6782-4b4e-bf97-d93dccdee167 req-361c963a-2838-47d4-b543-657a3a280c0c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:38:16 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-c29482f2-6782-4b4e-bf97-d93dccdee167 req-361c963a-2838-47d4-b543-657a3a280c0c service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:38:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-c29482f2-6782-4b4e-bf97-d93dccdee167 req-361c963a-2838-47d4-b543-657a3a280c0c service nova] Creating event network-vif-plugged:c7d43ab2-3180-42c1-83d4-a5e4904efd86 for instance f30f9b3c-3c23-4753-a464-da2662890f7c on user Apr 17 19:38:16 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-c29482f2-6782-4b4e-bf97-d93dccdee167 req-361c963a-2838-47d4-b543-657a3a280c0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026969 Apr 17 19:38:16 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 144/432] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:38:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:39:00 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:39:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6c1ce7a7-a1a2-4830-94df-266a8425cda9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 200 len: 1535 microversion: 2.1 time: 0.239311 Apr 17 19:39:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 145/433] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:39:00 2023] GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 1535 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] [instance: 10c21d45-e9eb-48a8-af00-d1ea5efd13a3] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=4 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:39:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] HTTP exception thrown: Instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 could not be found. Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Request method failure captured: Apr 17 19:39:02 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3 HTTP/1.1 Apr 17 19:39:02 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:39:02 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:39:02 user devstack@n-api.service[61727]: Connection: close Apr 17 19:39:02 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:39:02 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:39:02 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:39:02 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:39:02 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPZ7S2yF7dRWRjELV2M54LwYToePw3p6-BYuu061b3Eg50DBJTLpkLGMImuczev0ZcP5QiJo2Yi49KkQOkAacaqk8XOZLv_EUbC19N-gqB88G-SnQsdy0-AIGNrD1q1b_lBLeEV8WnT5iGea1UnqijxiF3yf45CSj4-MUlFyjoK5MXdI Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Project-Id: e5a720a783674c96b0c4bc4ebaafe1b1 Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520768636 Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e5a720a783674c96b0c4bc4ebaafe1b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5a720a783674c96b0c4bc4ebaafe1b1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5a720a783674c96b0c4bc4ebaafe1b1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520768636 Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Tenant-Id: e5a720a783674c96b0c4bc4ebaafe1b1 Apr 17 19:39:02 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520768636 Apr 17 19:39:02 user devstack@n-api.service[61727]: X-User: tempest-ServerRescueNegativeTestJSON-1520768636-project-member Apr 17 19:39:02 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:39:02 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:39:02 user devstack@n-api.service[61727]: X-User-Id: d634485279404fc6858c90e215f7f52f Apr 17 19:39:02 user devstack@n-api.service[61727]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520768636-project-member Apr 17 19:39:02 user devstack@n-api.service[61727]: method: > Apr 17 19:39:02 user devstack@n-api.service[61727]: exception: Instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 could not be found. Apr 17 19:39:02 user devstack@n-api.service[61727]: action_args: {'id': '10c21d45-e9eb-48a8-af00-d1ea5efd13a3'} Apr 17 19:39:02 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 could not be found. Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 could not be found. Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 could not be found. Apr 17 19:39:02 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:39:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] Returning 404 to user: Instance 10c21d45-e9eb-48a8-af00-d1ea5efd13a3 could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:39:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-529f7cfd-c405-4606-9d59-0d695c48df8b tempest-ServerRescueNegativeTestJSON-1520768636 tempest-ServerRescueNegativeTestJSON-1520768636-project-member] 10.0.0.210 "GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3" status: 404 len: 111 microversion: 2.1 time: 0.038635 Apr 17 19:39:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 145/434] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:39:02 2023] GET /compute/v2.1/servers/10c21d45-e9eb-48a8-af00-d1ea5efd13a3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=6 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:00 user devstack@n-api.service[61729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 19:40:00 user devstack@n-api.service[61729]: Mon Apr 17 19:40:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c (ip 10.0.0.210) !!! Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:00 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:40:00 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-6b905360-f593-46a4-9369-b2a26414331a tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 200 len: 1535 microversion: 2.1 time: 0.238165 Apr 17 19:40:00 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 145/435] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:40:00 2023] GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 1535 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Searching by: {'deleted': False, 'project_id': '183324fc7e8040058b3a5c9130c7415e'} {{(pid=61728) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:00 user devstack@n-api.service[61728]: DEBUG nova.compute.multi_cell_list [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61728) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 17 19:40:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-ca3d2994-fc03-4473-8ec5-76092b943a8b tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.275264 Apr 17 19:40:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Apr 17 19:40:00 2023] GET /compute/v2.1/servers => generated 340 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:40:00 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:01 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:40:01 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-00bb5c4d-e071-4398-a3be-61783f535956 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 200 len: 1535 microversion: 2.1 time: 0.248322 Apr 17 19:40:01 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 146/437] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:40:00 2023] GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 1535 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:02 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Going to try to terminate instance {{(pid=61729) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:40:02 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-8d3b2280-e1de-4218-b464-1daeb9d93ef6 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 204 len: 0 microversion: 2.1 time: 0.104342 Apr 17 19:40:02 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:40:02 2023] DELETE /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:02 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:03 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:40:03 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-1e92fb82-a621-4a39-b0be-9541c57a12ac tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 200 len: 1541 microversion: 2.1 time: 0.407119 Apr 17 19:40:03 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 147/439] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:40:02 2023] GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 1541 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:40:03 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-a5fb1a6b-88ef-4c19-a1cc-207bf0ed5df0 req-3788573c-f86b-4f32-8e4a-ed97e0ac373b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30f9b3c-3c23-4753-a464-da2662890f7c", "name": "network-vif-unplugged", "status": "completed", "tag": "c7d43ab2-3180-42c1-83d4-a5e4904efd86"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:40:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a5fb1a6b-88ef-4c19-a1cc-207bf0ed5df0 req-3788573c-f86b-4f32-8e4a-ed97e0ac373b service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a5fb1a6b-88ef-4c19-a1cc-207bf0ed5df0 req-3788573c-f86b-4f32-8e4a-ed97e0ac373b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:03 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-a5fb1a6b-88ef-4c19-a1cc-207bf0ed5df0 req-3788573c-f86b-4f32-8e4a-ed97e0ac373b service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:03 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-a5fb1a6b-88ef-4c19-a1cc-207bf0ed5df0 req-3788573c-f86b-4f32-8e4a-ed97e0ac373b service nova] Creating event network-vif-unplugged:c7d43ab2-3180-42c1-83d4-a5e4904efd86 for instance f30f9b3c-3c23-4753-a464-da2662890f7c on user Apr 17 19:40:03 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-a5fb1a6b-88ef-4c19-a1cc-207bf0ed5df0 req-3788573c-f86b-4f32-8e4a-ed97e0ac373b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.220815 Apr 17 19:40:03 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 147/440] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:40:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:40:04 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-da204787-3b3a-4e29-97f1-c36c6eff289f req-9ce6b4c9-c67c-45e7-b3a8-8936a4df38ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30f9b3c-3c23-4753-a464-da2662890f7c", "name": "network-vif-deleted", "tag": "c7d43ab2-3180-42c1-83d4-a5e4904efd86"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:40:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-da204787-3b3a-4e29-97f1-c36c6eff289f req-9ce6b4c9-c67c-45e7-b3a8-8936a4df38ec service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-da204787-3b3a-4e29-97f1-c36c6eff289f req-9ce6b4c9-c67c-45e7-b3a8-8936a4df38ec service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-da204787-3b3a-4e29-97f1-c36c6eff289f req-9ce6b4c9-c67c-45e7-b3a8-8936a4df38ec service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:04 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-da204787-3b3a-4e29-97f1-c36c6eff289f req-9ce6b4c9-c67c-45e7-b3a8-8936a4df38ec service nova] Creating event network-vif-deleted:c7d43ab2-3180-42c1-83d4-a5e4904efd86 for instance f30f9b3c-3c23-4753-a464-da2662890f7c on user Apr 17 19:40:04 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-da204787-3b3a-4e29-97f1-c36c6eff289f req-9ce6b4c9-c67c-45e7-b3a8-8936a4df38ec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029468 Apr 17 19:40:04 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 147/441] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:40:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:40:05 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-a6080ad3-aced-4623-8648-7c5fc8a451b7 req-be62f14d-9806-4fd3-ab90-7b2a0391fb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f30f9b3c-3c23-4753-a464-da2662890f7c", "name": "network-vif-plugged", "status": "completed", "tag": "c7d43ab2-3180-42c1-83d4-a5e4904efd86"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:40:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a6080ad3-aced-4623-8648-7c5fc8a451b7 req-be62f14d-9806-4fd3-ab90-7b2a0391fb7e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a6080ad3-aced-4623-8648-7c5fc8a451b7 req-be62f14d-9806-4fd3-ab90-7b2a0391fb7e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:05 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-a6080ad3-aced-4623-8648-7c5fc8a451b7 req-be62f14d-9806-4fd3-ab90-7b2a0391fb7e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-a6080ad3-aced-4623-8648-7c5fc8a451b7 req-be62f14d-9806-4fd3-ab90-7b2a0391fb7e service nova] Creating event network-vif-plugged:c7d43ab2-3180-42c1-83d4-a5e4904efd86 for instance f30f9b3c-3c23-4753-a464-da2662890f7c on user Apr 17 19:40:05 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-a6080ad3-aced-4623-8648-7c5fc8a451b7 req-be62f14d-9806-4fd3-ab90-7b2a0391fb7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039189 Apr 17 19:40:05 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 148/442] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=8 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: f30f9b3c-3c23-4753-a464-da2662890f7c] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.wsgi [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] HTTP exception thrown: Instance f30f9b3c-3c23-4753-a464-da2662890f7c could not be found. Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Request method failure captured: Apr 17 19:40:53 user devstack@n-api.service[61727]: request: GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c HTTP/1.1 Apr 17 19:40:53 user devstack@n-api.service[61727]: Accept: application/json Apr 17 19:40:53 user devstack@n-api.service[61727]: Accept-Encoding: identity Apr 17 19:40:53 user devstack@n-api.service[61727]: Connection: close Apr 17 19:40:53 user devstack@n-api.service[61727]: Content-Length: 0 Apr 17 19:40:53 user devstack@n-api.service[61727]: Content-Type: application/json Apr 17 19:40:53 user devstack@n-api.service[61727]: Host: 10.0.0.210 Apr 17 19:40:53 user devstack@n-api.service[61727]: Openstack-System-Scope: None Apr 17 19:40:53 user devstack@n-api.service[61727]: User-Agent: python-urllib3/1.26.15 Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Auth-Token: gAAAAABkPaAYjYJ3ulcZHro64c_v5C0nWh6vCPTIiZN-RoB12xiB0bArdNtA7DIcaYC4mdGp6mD-aY-4sgfXdijSSpOZcNJznmT_XIPe2djhcboj22hAEkfRxxns1J9vTLmSgsAt8OxHhoOO0DNDNu45te41ZZEy5Wf99ITXWrDA6NVUcJVyt48 Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Domain-Id: None Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Domain-Name: None Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Identity-Status: Confirmed Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Is-Admin-Project: True Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Project-Domain-Id: default Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Project-Domain-Name: Default Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Project-Id: 183324fc7e8040058b3a5c9130c7415e Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Project-Name: tempest-TestMinimumBasicScenario-1206264269 Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Role: reader,member Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Roles: reader,member Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/183324fc7e8040058b3a5c9130c7415e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/183324fc7e8040058b3a5c9130c7415e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/183324fc7e8040058b3a5c9130c7415e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Tenant: tempest-TestMinimumBasicScenario-1206264269 Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Tenant-Id: 183324fc7e8040058b3a5c9130c7415e Apr 17 19:40:53 user devstack@n-api.service[61727]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1206264269 Apr 17 19:40:53 user devstack@n-api.service[61727]: X-User: tempest-TestMinimumBasicScenario-1206264269-project-member Apr 17 19:40:53 user devstack@n-api.service[61727]: X-User-Domain-Id: default Apr 17 19:40:53 user devstack@n-api.service[61727]: X-User-Domain-Name: Default Apr 17 19:40:53 user devstack@n-api.service[61727]: X-User-Id: f6dc578937fa4cbd9665652bbd0153fa Apr 17 19:40:53 user devstack@n-api.service[61727]: X-User-Name: tempest-TestMinimumBasicScenario-1206264269-project-member Apr 17 19:40:53 user devstack@n-api.service[61727]: method: > Apr 17 19:40:53 user devstack@n-api.service[61727]: exception: Instance f30f9b3c-3c23-4753-a464-da2662890f7c could not be found. Apr 17 19:40:53 user devstack@n-api.service[61727]: action_args: {'id': 'f30f9b3c-3c23-4753-a464-da2662890f7c'} Apr 17 19:40:53 user devstack@n-api.service[61727]: {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f30f9b3c-3c23-4753-a464-da2662890f7c could not be found. Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f30f9b3c-3c23-4753-a464-da2662890f7c could not be found. Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f30f9b3c-3c23-4753-a464-da2662890f7c could not be found. Apr 17 19:40:53 user devstack@n-api.service[61727]: ERROR nova.api.openstack.wsgi Apr 17 19:40:53 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Returning 404 to user: Instance f30f9b3c-3c23-4753-a464-da2662890f7c could not be found. {{(pid=61727) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:40:53 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-52b30577-5c4b-48dc-baab-2679fb7025c5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c" status: 404 len: 111 microversion: 2.1 time: 0.037668 Apr 17 19:40:53 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 148/443] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:40:53 2023] GET /compute/v2.1/servers/f30f9b3c-3c23-4753-a464-da2662890f7c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:40:53 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:53 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:53 user devstack@n-api.service[61729]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 17 19:40:53 user devstack@n-api.service[61729]: Mon Apr 17 19:40:53 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-312513621 (ip 10.0.0.210) !!! Apr 17 19:40:53 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-83b742d6-edf2-4530-acf1-56a5795ffbf7 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '.version_select at 0x7f84d1c63c70>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:53 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-83b742d6-edf2-4530-acf1-56a5795ffbf7 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-312513621" status: 202 len: 0 microversion: 2.1 time: 0.038513 Apr 17 19:40:53 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 148/444] 10.0.0.210 () {62 vars in 1346 bytes} [Mon Apr 17 19:40:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-312513621 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 17 19:40:55 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:55 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:55 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=16 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:40:55 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-e7b0e39f-de9b-40f3-b8a0-0b8321c76bdb tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Action: 'create', calling method: .version_select at 0x7f84d1eee7a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1646840890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODukczWDm+gLyEdrtJfCZ+b5mR6nryVL5+MuXzYoiVo69BfqbHz+WkTv9ozecXweHnVwADJnw2ajJOxPTHsVyE1U6UTuc38NMPH/VvBp3mDxB7JYFD8sxzgOatVCPcNMQ=="}} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:40:55 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-e7b0e39f-de9b-40f3-b8a0-0b8321c76bdb tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for project 183324fc7e8040058b3a5c9130c7415e. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:40:55 user devstack@n-api.service[61728]: DEBUG nova.quota [None req-e7b0e39f-de9b-40f3-b8a0-0b8321c76bdb tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for user f6dc578937fa4cbd9665652bbd0153fa and project 183324fc7e8040058b3a5c9130c7415e. Resources: {'key_pairs'} {{(pid=61728) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:40:55 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-e7b0e39f-de9b-40f3-b8a0-0b8321c76bdb tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049716 Apr 17 19:40:55 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 149/445] 10.0.0.210 () {64 vars in 1236 bytes} [Mon Apr 17 19:40:55 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:40:55 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1607141485", "imageRef": "222e40c8-380b-459e-8826-dd99da1c80d3", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1646840890", "networks": [{"uuid": "749c9efa-f82b-4393-9bef-5426eac09e93"}]}} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.network.neutron [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] validate_networks() for [('749c9efa-f82b-4393-9bef-5426eac09e93', None, None, None, None, None)] {{(pid=61727) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Flavor limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Image limits 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Flavor pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Image pref 0:0:0 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.virt.hardware [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61727) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for project 183324fc7e8040058b3a5c9130c7415e. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.quota [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Getting quotas for user f6dc578937fa4cbd9665652bbd0153fa and project 183324fc7e8040058b3a5c9130c7415e. Resources: {'ram', 'instances', 'cores'} {{(pid=61727) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Going to run 1 instances... {{(pid=61727) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 17 19:40:56 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='222e40c8-380b-459e-8826-dd99da1c80d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61727) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 17 19:40:56 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-33798a9a-3e6a-4e75-b3c0-7c5f631fde03 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.899617 Apr 17 19:40:56 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 149/446] 10.0.0.210 () {64 vars in 1224 bytes} [Mon Apr 17 19:40:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 17 19:40:56 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-7c791cc5-a928-4481-a536-45856b84c249 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:40:56 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-7c791cc5-a928-4481-a536-45856b84c249 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:40:56 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-7c791cc5-a928-4481-a536-45856b84c249 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:40:56 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-7c791cc5-a928-4481-a536-45856b84c249 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 200 len: 1253 microversion: 2.1 time: 0.063611 Apr 17 19:40:56 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 149/447] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:40:56 2023] GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 1253 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:41:00 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-8d83f51a-4f8d-4225-8117-abf69cd786d5 req-6241285c-2b7d-4450-a6c1-fde50c200945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "278ec068-27be-4792-895a-a415a1687987", "tag": "615bb091-c483-433c-8418-00fb372beb9b"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:41:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-8d83f51a-4f8d-4225-8117-abf69cd786d5 req-6241285c-2b7d-4450-a6c1-fde50c200945 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:41:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-8d83f51a-4f8d-4225-8117-abf69cd786d5 req-6241285c-2b7d-4450-a6c1-fde50c200945 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:41:00 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-8d83f51a-4f8d-4225-8117-abf69cd786d5 req-6241285c-2b7d-4450-a6c1-fde50c200945 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:41:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-8d83f51a-4f8d-4225-8117-abf69cd786d5 req-6241285c-2b7d-4450-a6c1-fde50c200945 service nova] Creating event network-changed:615bb091-c483-433c-8418-00fb372beb9b for instance 278ec068-27be-4792-895a-a415a1687987 on user Apr 17 19:41:00 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-8d83f51a-4f8d-4225-8117-abf69cd786d5 req-6241285c-2b7d-4450-a6c1-fde50c200945 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035987 Apr 17 19:41:00 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 150/448] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:41:02 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-75131238-76c6-4c9f-87dc-c3404975fdf4 req-07928859-d675-429d-a617-b1a78f92d017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278ec068-27be-4792-895a-a415a1687987", "name": "network-vif-plugged", "status": "completed", "tag": "615bb091-c483-433c-8418-00fb372beb9b"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:41:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-75131238-76c6-4c9f-87dc-c3404975fdf4 req-07928859-d675-429d-a617-b1a78f92d017 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:41:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-75131238-76c6-4c9f-87dc-c3404975fdf4 req-07928859-d675-429d-a617-b1a78f92d017 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:41:02 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-75131238-76c6-4c9f-87dc-c3404975fdf4 req-07928859-d675-429d-a617-b1a78f92d017 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:41:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-75131238-76c6-4c9f-87dc-c3404975fdf4 req-07928859-d675-429d-a617-b1a78f92d017 service nova] Creating event network-vif-plugged:615bb091-c483-433c-8418-00fb372beb9b for instance 278ec068-27be-4792-895a-a415a1687987 on user Apr 17 19:41:02 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-75131238-76c6-4c9f-87dc-c3404975fdf4 req-07928859-d675-429d-a617-b1a78f92d017 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076393 Apr 17 19:41:02 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:41:04 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-eae1899e-0b3b-4362-930d-2b18cdaf9c44 req-f02af67f-189b-4cf1-b327-566a9e9c017d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278ec068-27be-4792-895a-a415a1687987", "name": "network-vif-plugged", "status": "completed", "tag": "615bb091-c483-433c-8418-00fb372beb9b"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:41:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-eae1899e-0b3b-4362-930d-2b18cdaf9c44 req-f02af67f-189b-4cf1-b327-566a9e9c017d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:41:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-eae1899e-0b3b-4362-930d-2b18cdaf9c44 req-f02af67f-189b-4cf1-b327-566a9e9c017d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:41:04 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-eae1899e-0b3b-4362-930d-2b18cdaf9c44 req-f02af67f-189b-4cf1-b327-566a9e9c017d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:41:04 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-eae1899e-0b3b-4362-930d-2b18cdaf9c44 req-f02af67f-189b-4cf1-b327-566a9e9c017d service nova] Creating event network-vif-plugged:615bb091-c483-433c-8418-00fb372beb9b for instance 278ec068-27be-4792-895a-a415a1687987 on user Apr 17 19:41:04 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-eae1899e-0b3b-4362-930d-2b18cdaf9c44 req-f02af67f-189b-4cf1-b327-566a9e9c017d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029896 Apr 17 19:41:04 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 150/450] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:41:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell0:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:41:47 user devstack@n-api.service[61728]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 17 19:41:47 user devstack@n-api.service[61728]: Mon Apr 17 19:41:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 (ip 10.0.0.210) !!! Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:41:47 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:41:47 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-9fc75bd7-5bee-410b-b92d-4f85ed8c1ad9 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 200 len: 1536 microversion: 2.1 time: 0.299755 Apr 17 19:41:47 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 151/451] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:41:47 2023] GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 1536 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=2 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell0:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=6 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:47 user devstack@n-api.service[61727]: DEBUG nova.policy [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61727) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:42:47 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-ddfb0db2-1c2f-4bc9-84e0-008ea6903250 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 200 len: 1536 microversion: 2.1 time: 0.292897 Apr 17 19:42:47 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:42:47 2023] GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 1536 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell0:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG dbcounter [-] [61729] Writing DB stats nova_cell1:SELECT=2 {{(pid=61729) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Searching by: {'deleted': False, 'project_id': '183324fc7e8040058b3a5c9130c7415e'} {{(pid=61729) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:47 user devstack@n-api.service[61729]: DEBUG nova.compute.multi_cell_list [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61729) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 17 19:42:47 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-e65f7d6e-0e35-4d8c-a674-c2fd259ef4fa tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.188579 Apr 17 19:42:47 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 151/453] 10.0.0.210 () {62 vars in 1202 bytes} [Mon Apr 17 19:42:47 2023] GET /compute/v2.1/servers => generated 341 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=2 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=6 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:47 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:48 user devstack@n-api.service[61728]: DEBUG nova.policy [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61728) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:42:48 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-b12776d6-fc1c-4a9a-91b9-5165950faabf tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 200 len: 1536 microversion: 2.1 time: 0.154679 Apr 17 19:42:48 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 152/454] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:42:47 2023] GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 1536 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61727) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:49 user devstack@n-api.service[61727]: DEBUG nova.compute.api [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Going to try to terminate instance {{(pid=61727) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 17 19:42:49 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-2d46c835-dcc8-4cf2-83c5-19420ea1554e tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 204 len: 0 microversion: 2.1 time: 0.114470 Apr 17 19:42:49 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 152/455] 10.0.0.210 () {62 vars in 1316 bytes} [Mon Apr 17 19:42:49 2023] DELETE /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG nova.compute.api [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61729) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:49 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:50 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [req-db84ea19-a51d-4d6e-99ed-e081ac4bdf1a req-c7ed2469-d34b-40ba-8a0d-98d5091b204d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278ec068-27be-4792-895a-a415a1687987", "name": "network-vif-unplugged", "status": "completed", "tag": "615bb091-c483-433c-8418-00fb372beb9b"}]} {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:42:50 user devstack@n-api.service[61729]: DEBUG nova.policy [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6dc578937fa4cbd9665652bbd0153fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183324fc7e8040058b3a5c9130c7415e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61729) authorize /opt/stack/nova/nova/policy.py:203}} Apr 17 19:42:50 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [None req-5892469d-5f0c-445c-b7d4-60d0fda5817d tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 200 len: 1542 microversion: 2.1 time: 0.367814 Apr 17 19:42:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-db84ea19-a51d-4d6e-99ed-e081ac4bdf1a req-c7ed2469-d34b-40ba-8a0d-98d5091b204d service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-db84ea19-a51d-4d6e-99ed-e081ac4bdf1a req-c7ed2469-d34b-40ba-8a0d-98d5091b204d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:50 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [req-db84ea19-a51d-4d6e-99ed-e081ac4bdf1a req-c7ed2469-d34b-40ba-8a0d-98d5091b204d service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:50 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 152/456] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:42:49 2023] GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 1542 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 17 19:42:50 user devstack@n-api.service[61728]: INFO nova.api.openstack.compute.server_external_events [req-db84ea19-a51d-4d6e-99ed-e081ac4bdf1a req-c7ed2469-d34b-40ba-8a0d-98d5091b204d service nova] Creating event network-vif-unplugged:615bb091-c483-433c-8418-00fb372beb9b for instance 278ec068-27be-4792-895a-a415a1687987 on user Apr 17 19:42:50 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [req-db84ea19-a51d-4d6e-99ed-e081ac4bdf1a req-c7ed2469-d34b-40ba-8a0d-98d5091b204d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039362 Apr 17 19:42:50 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 153/457] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:42:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:42:51 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [req-fc5573c7-1d5f-43e8-a999-3beb562d03af req-ac7ce464-56e6-4677-a488-ef709c17480e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278ec068-27be-4792-895a-a415a1687987", "name": "network-vif-deleted", "tag": "615bb091-c483-433c-8418-00fb372beb9b"}]} {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:42:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-fc5573c7-1d5f-43e8-a999-3beb562d03af req-ac7ce464-56e6-4677-a488-ef709c17480e service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-fc5573c7-1d5f-43e8-a999-3beb562d03af req-ac7ce464-56e6-4677-a488-ef709c17480e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:51 user devstack@n-api.service[61727]: DEBUG oslo_concurrency.lockutils [req-fc5573c7-1d5f-43e8-a999-3beb562d03af req-ac7ce464-56e6-4677-a488-ef709c17480e service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61727) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.compute.server_external_events [req-fc5573c7-1d5f-43e8-a999-3beb562d03af req-ac7ce464-56e6-4677-a488-ef709c17480e service nova] Creating event network-vif-deleted:615bb091-c483-433c-8418-00fb372beb9b for instance 278ec068-27be-4792-895a-a415a1687987 on user Apr 17 19:42:51 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [req-fc5573c7-1d5f-43e8-a999-3beb562d03af req-ac7ce464-56e6-4677-a488-ef709c17480e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086592 Apr 17 19:42:51 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 153/458] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:42:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:42:52 user devstack@n-api.service[61729]: DEBUG nova.api.openstack.wsgi [req-f09a2d5c-6446-46d3-943c-18131c2517fc req-057637ef-8a2d-4c70-8dd7-07ac37181019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "278ec068-27be-4792-895a-a415a1687987", "name": "network-vif-plugged", "status": "completed", "tag": "615bb091-c483-433c-8418-00fb372beb9b"}]} {{(pid=61729) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 17 19:42:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-f09a2d5c-6446-46d3-943c-18131c2517fc req-057637ef-8a2d-4c70-8dd7-07ac37181019 service nova] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:42:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-f09a2d5c-6446-46d3-943c-18131c2517fc req-057637ef-8a2d-4c70-8dd7-07ac37181019 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:42:52 user devstack@n-api.service[61729]: DEBUG oslo_concurrency.lockutils [req-f09a2d5c-6446-46d3-943c-18131c2517fc req-057637ef-8a2d-4c70-8dd7-07ac37181019 service nova] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61729) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:42:52 user devstack@n-api.service[61729]: INFO nova.api.openstack.compute.server_external_events [req-f09a2d5c-6446-46d3-943c-18131c2517fc req-057637ef-8a2d-4c70-8dd7-07ac37181019 service nova] Creating event network-vif-plugged:615bb091-c483-433c-8418-00fb372beb9b for instance 278ec068-27be-4792-895a-a415a1687987 on user Apr 17 19:42:52 user devstack@n-api.service[61729]: INFO nova.api.openstack.requestlog [req-f09a2d5c-6446-46d3-943c-18131c2517fc req-057637ef-8a2d-4c70-8dd7-07ac37181019 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028297 Apr 17 19:42:52 user devstack@n-api.service[61729]: [pid: 61729|app: 0|req: 153/459] 10.0.0.210 () {68 vars in 1394 bytes} [Mon Apr 17 19:42:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_api:SELECT=4 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG dbcounter [-] [61728] Writing DB stats nova_cell1:SELECT=8 {{(pid=61728) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '>' {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG nova.compute.api [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] [instance: 278ec068-27be-4792-895a-a415a1687987] Fetching instance by UUID {{(pid=61728) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Acquiring lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG oslo_concurrency.lockutils [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Lock "557b61a6-7c46-4750-bdf8-90d5a8f88bb1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61728) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 17 19:43:40 user devstack@n-api.service[61728]: INFO nova.api.openstack.wsgi [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] HTTP exception thrown: Instance 278ec068-27be-4792-895a-a415a1687987 could not be found. Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Request method failure captured: Apr 17 19:43:40 user devstack@n-api.service[61728]: request: GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 HTTP/1.1 Apr 17 19:43:40 user devstack@n-api.service[61728]: Accept: application/json Apr 17 19:43:40 user devstack@n-api.service[61728]: Accept-Encoding: identity Apr 17 19:43:40 user devstack@n-api.service[61728]: Connection: close Apr 17 19:43:40 user devstack@n-api.service[61728]: Content-Length: 0 Apr 17 19:43:40 user devstack@n-api.service[61728]: Content-Type: application/json Apr 17 19:43:40 user devstack@n-api.service[61728]: Host: 10.0.0.210 Apr 17 19:43:40 user devstack@n-api.service[61728]: Openstack-System-Scope: None Apr 17 19:43:40 user devstack@n-api.service[61728]: User-Agent: python-urllib3/1.26.15 Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Auth-Token: gAAAAABkPaAYjYJ3ulcZHro64c_v5C0nWh6vCPTIiZN-RoB12xiB0bArdNtA7DIcaYC4mdGp6mD-aY-4sgfXdijSSpOZcNJznmT_XIPe2djhcboj22hAEkfRxxns1J9vTLmSgsAt8OxHhoOO0DNDNu45te41ZZEy5Wf99ITXWrDA6NVUcJVyt48 Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Domain-Id: None Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Domain-Name: None Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Identity-Status: Confirmed Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Is-Admin-Project: True Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Project-Domain-Id: default Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Project-Domain-Name: Default Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Project-Id: 183324fc7e8040058b3a5c9130c7415e Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Project-Name: tempest-TestMinimumBasicScenario-1206264269 Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Role: reader,member Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Roles: reader,member Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/183324fc7e8040058b3a5c9130c7415e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/183324fc7e8040058b3a5c9130c7415e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/183324fc7e8040058b3a5c9130c7415e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Tenant: tempest-TestMinimumBasicScenario-1206264269 Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Tenant-Id: 183324fc7e8040058b3a5c9130c7415e Apr 17 19:43:40 user devstack@n-api.service[61728]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1206264269 Apr 17 19:43:40 user devstack@n-api.service[61728]: X-User: tempest-TestMinimumBasicScenario-1206264269-project-member Apr 17 19:43:40 user devstack@n-api.service[61728]: X-User-Domain-Id: default Apr 17 19:43:40 user devstack@n-api.service[61728]: X-User-Domain-Name: Default Apr 17 19:43:40 user devstack@n-api.service[61728]: X-User-Id: f6dc578937fa4cbd9665652bbd0153fa Apr 17 19:43:40 user devstack@n-api.service[61728]: X-User-Name: tempest-TestMinimumBasicScenario-1206264269-project-member Apr 17 19:43:40 user devstack@n-api.service[61728]: method: > Apr 17 19:43:40 user devstack@n-api.service[61728]: exception: Instance 278ec068-27be-4792-895a-a415a1687987 could not be found. Apr 17 19:43:40 user devstack@n-api.service[61728]: action_args: {'id': '278ec068-27be-4792-895a-a415a1687987'} Apr 17 19:43:40 user devstack@n-api.service[61728]: {{(pid=61728) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 278ec068-27be-4792-895a-a415a1687987 could not be found. Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 278ec068-27be-4792-895a-a415a1687987 could not be found. Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 278ec068-27be-4792-895a-a415a1687987 could not be found. Apr 17 19:43:40 user devstack@n-api.service[61728]: ERROR nova.api.openstack.wsgi Apr 17 19:43:40 user devstack@n-api.service[61728]: DEBUG nova.api.openstack.wsgi [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Returning 404 to user: Instance 278ec068-27be-4792-895a-a415a1687987 could not be found. {{(pid=61728) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 17 19:43:40 user devstack@n-api.service[61728]: INFO nova.api.openstack.requestlog [None req-6e8404c1-3225-4ed4-a532-7a636f1f2ff5 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987" status: 404 len: 111 microversion: 2.1 time: 0.087283 Apr 17 19:43:40 user devstack@n-api.service[61728]: [pid: 61728|app: 0|req: 154/460] 10.0.0.210 () {62 vars in 1313 bytes} [Mon Apr 17 19:43:40 2023] GET /compute/v2.1/servers/278ec068-27be-4792-895a-a415a1687987 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 17 19:43:40 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:43:40 user devstack@n-api.service[61727]: DEBUG dbcounter [-] [61727] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61727) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 17 19:43:40 user devstack@n-api.service[61727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 17 19:43:40 user devstack@n-api.service[61727]: Mon Apr 17 19:43:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1646840890 (ip 10.0.0.210) !!! Apr 17 19:43:40 user devstack@n-api.service[61727]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 17 19:43:40 user devstack@n-api.service[61727]: Mon Apr 17 19:43:40 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1646840890 (ip 10.0.0.210) !!! Apr 17 19:43:40 user devstack@n-api.service[61727]: DEBUG nova.api.openstack.wsgi [None req-7f565dc9-f3ef-4995-a3b2-b034ae2524f4 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] Calling method '.version_select at 0x7f84d1cd57e0>' {{(pid=61727) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 17 19:43:40 user devstack@n-api.service[61727]: INFO nova.api.openstack.requestlog [None req-7f565dc9-f3ef-4995-a3b2-b034ae2524f4 tempest-TestMinimumBasicScenario-1206264269 tempest-TestMinimumBasicScenario-1206264269-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1646840890" status: 202 len: 0 microversion: 2.1 time: 0.048112 Apr 17 19:43:40 user devstack@n-api.service[61727]: [pid: 61727|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1349 bytes} [Mon Apr 17 19:43:40 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1646840890 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)